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ABSTRACT 


A  critical  bottleneck  exists  in  Autonomous  Underwater  Vehicle  (AUV) 
design  and  development.  It  is  tremendously  difficult  to  observe,  communicate 
with  and  test  underwater  robots,  because  they  operate  in  a  remote  and  hazardous 
environment  where  physical  dynamics  and  .sensing  modalities  are 
counterintuitive. 

An  underwater  virtual  world  can  comprehensively  model  all  salient 
functional  characteristics  of  the  real  world  in  real  time.  This  virtual  world  is 
designed  from  the  perspective  of  the  robot,  enabling  realistic  AUV  evaluation 
and  testing  in  the  laboratory.  Three-dimensional  real-time  computer  graphics 
are  oui  window  into  that  virtual  world. 


Visualization  of  lobot  interactions  within  a  virtual  world  permits 
sophisticated  analyses  of  robot  performance  that  are  otherwise  unavailable. 

Sontu-  visualization  permits  researchers  to  accurately  "look  over  the  robot’s 
shoulder"  or  even  "see  through  the  robot’s  eyes"  to  intuitively  understand 
sensor-environment  interactions.  Extending  the  theoretical  derivation  of  a  set  of 
six-degree-of-freedom  hydrodynamics  equations  has  provided  a  fully  general 
physics-ba.sed  model  capable  of  producing  highly  non-linear  yet  experimentally- 
verifiable  response  in  real  time. 

Distribution  of  underwater  virtual  world  components  enables  scalability 
and  real  time  response.  The  IEEE  Distributed  Interactive  Simulation  (DIS) 
protocol  is  used  for  compatible  live  interaction  with  other  virtual  worlds. 
Network  connections  allow  remote  access,  demonstrated  via  Multicast  Backbone 


(MBone)  audio  and  video  collaboration  with  researchers  at  remote  locations. 
Integrating  the  World-Wide  Web  allows  rapid  access  to  resources  distributed 
across  the  Internet. 

This  dissertation  presents  the  frontier  of  3D  real-time  graphics  to  support 
underwater  robotics,  scientific  ocean  exploration,  sonar  visualization  and 
worldwide  collaboration.  , 
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I.  A  VIRTUAL  WORLD  FOR  AN  AUTONOMOUS  UNDERWATER  VEHICLE 


A.  INTRODUCTION 

A  critical  bottleneck  exists  in  Autonomous  Underwater  Veh'cle  (AUV)  design 
and  development.  It  is  tremendously  difficult  to  observe,  ccmmunicate  with  and  test 
underwater  roliots,  because  they  operate  in  a  remote  and  hazardous  environment  where 
physical  dynamics  and  sensing  modalities  are  counterintuitive.  An  underwater  virtual 
world  can  comprehensively  model  all  tiecessai'y  functional  characteristics  of  the  real 
vN  oi'ld  in  real  time.  This  virtual  world  is  designed  from  the  perspective  of  the  robot, 
enabling  realistic  AUV  evaluation  and  testing  in  the  laboratory.  3D  real-time  graphics 
are  our  window  into  the  virtual  world.  A  networked  architecture  enables  multiple 
world  components  to  operate  collectively  in  real  time,  and  also  permits  world-wide 
ob.servation  and  collaboration  with  other  scientists  interested  in  the  robot  and  virtual 
uorld.  This  architecture  was  first  proposed  in  (Brutzman  92d). 

This  dissertation  develops  and  de.scribes  the  .software  architecture  of  an 
underwater  virtual  world  for  an  autonomous  underwater  robot.  Multiple  component 
models  provide  interactive  real-time  response  for  robot  and  human  users.  Theoretical 
development  stmsses  a  .scalable  distributed  network  approach,  interoperability  between 
models,  physics-bu.sed  reproduction  of  real-world  response,  and  compatibility  with 
open  systems  approaches.  Implementation  of  the  underwater  vhtual  world  and 
autonomous  underwater  robot  arc  documented  in  a  companion  software  reference 
( Brutzman  y4e). 

IL  MOTIVATION 

Underwater  robots  are  normally  called  Autonomous  Underwater  Vehicles 
(AUVs).  not  becau.se  they  are  intended  to  carry  people  but  rather  because  they  ai'e 
designed  to  intelligently  and  independently  convey  sensors  and  payloads.  AUVs  must 
accomplish  complex  tasks  and  diverse  missions  while  maintaining  stable  physical 
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t'oiiti'ol  with  six  spatial  degrees  of  freedom.  Little  or  no  eommunication  with  distant 
human  supervisors  is  possible,  When  compared  to  indoor,  ground,  airborne  or  space 
environments,  the  underwater  domain  typically  imposes  the  most  restrictive  physical 
control  and  sensor  limitations  upon  a  robot.  Underwater  robot  design  requirements 
therefore  motivate  this  examination.  Considerations  and  conclusions  remain  pertinent 
as  worst-case  examples  relative  to  other  environments. 

large  gap  exists  between  the  projections  of  theory  and  the  actual  practice  of 
underwater  robot  design.  Despite  a  large  number  of  remotely  operated  submersibles 
and  a  rich  field  of  autonomous  robot  research  results  (Iyengar  yOa,  yOb),  few  AUVs 
exist  and  their  capabilities  are  limited.  Cost,  inaccessibility  and  .scope  of  AUV  design 
restrict  the  number  and  reach  of  players  involved.  Interactions  and  interdependencies 
between  hardware  and  software  component  problems  are  poorly  understood.  Testing 
is  difficult,  tedious,  infrequent  and  potentially  hazardous.  Meaningful  evaluation  of 
results  is  hampered  by  overall  problem  complexity,  sensor  inadequacies  and  human 
inability  to  directly  ob.serve  the  robot  in  situ.  Potential  loss  of  an  autonomous 
underwater  robot  is  generally  intolerable  due  to  tremendous  investment  in  time  and 
resources,  likelihood  that  any  failure  will  become  catastrophic  and  difficulty  of 
recovery. 

Underwater  robot  progress  has  been  slow  and  painstaking  for  many  reasons.  By 
necessity  most  research  is  performed  piecemeal  and  incrementally.  For  example,  a 
narrow  problem  might  be  identified  as  suitable  for  solution  by  a  particular  artificial 
intelligence  (Al)  paradigm  and  then  examined  in  great  detail.  Conjectures  and  theories 
are  u.sed  to  create  an  implementation  which  is  tested  by  building  a  model  or  simulation 
specifically  suited  to  the  problem  in  question.  Test  success  or  failure  is  used  to 
interpret  validity  of  conclusions.  Unfortunately,  integration  of  the  design  process  or 
even  final  results  into  a  working  robot  is  often  difficult  or  impossible.  Lack  of 
integrated  testing  inevents  complete  verification  of  conclusions. 

AUV  design  must  provide  autonomy,  stability  and  reliability  with  little  tolerance 
for  error.  Control  systems  require  particular  attention  since  closed-form  solutions  for 
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many  hydrodynamics  control  issues  are  unknown.  In  addition.  A1  methodologies  are 
essential  for  many  critical  robot  software  components,  but  the  interaction  complexity 
and  emergent  behavior  of  multiple  inteiacting  .\1  proces.ses  is  poorly  understood, 
rarely  tested  and  impossible  to  tormally  speedy  (.Shank  91).  Better  approaches  are 
needed  to  support  coordinated  leseaich,  design  and  iniplementation  of  underwater 
robots. 

Despite  the.se  many  handicaps,  the  numerous  challenges  of  operating  in  the 
underwater  environment  force  designers  to  build  robots  that  ’arc  truly  robust, 
autonomous,  mobile  and  stable.  This  fits  w'ell  with  a  motivating  philosophy  of 
Hans  Moravec  (Moravec  S3,  88): 

..  solving  the  day  to  day  problems  of  developing  a  mobile  organi.sm  steers  one  in 
the  direction  of  general  intelligence...  Mobile  robotics  may  or  may  not  be  the 
fastest  way  to  airive  at  general  human  competence  in  machines,  but  1  believe  it 
is  one  of  the  surest  roads,  (Moravec  83) 
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C.  OBJPXTIVES 

This  dissertation  addresses  the  following  research  questions: 

•  What  is  the  software  architecture  required  to  build  an  underwater  virtual  world 
for  an  autonomous  underwater  vehicle'.' 

•  How  an  underwater  robot  be  connected  to  a  virtual  world  .so  seamlessly  that 
operation  in  the  real  world  or  a  virtual  world  is  transparent  to  the  robot'.' 

•  What  previous  work  in  robotics,  simulation.  3D  interactive  computer  graphics, 
hydrodynamics,  networking  and  sonar  visualization  ai'e  pertinent  to  construction 
of  an  underwater  virtual  world'.' 

»  What  are  the  functional  specifications  of  a  prototypical  AUV,  and  what  are  the 
functional  .specifications  of  robot  interactions  with  the  sun'ounding  environment'.' 

•  How  can  3D  real-time  interactive  computer  graphics  support  wide-scale  general 
access  to  virtual  worlds'?  Specifically,  how  can  computer  graphics  be  used  to 
build  windows  into  an  underwater  virtual  world  that  are  responsive,  accurate, 
distributable,  represent  objects  in  openly  standardized  formats,  and  provide 
portability  to  multiple  computer  architectures'? 

•  What  is  the  structure  and  derivation  for  an  accurate  six  degree-of-freedom 
underwater  rigid  body  hydrodynamics  model'?  The  model  must  precisely 
reproduce  vehicle  physical  response  in  real  time,  while  responding  to  modeled 
ocean  currents  and  control  orders  from  the  vehicle  itself.  The  hydrodynamics 
model  must  be  general,  verifiable,  parameter;  able  for  other  vehicles,  and 
suitable  for  distributed  simulation.  Such  a  model  is  highly  complex  due  to 
multiple  interacting  effects  coupled  between  all  six  degrees  of  freedom. 

•  What  are  the  principal  network  software  components  needed  to  build  a  virtual 
world  that  can  scale  up  to  very  large  numbers  of  interacting  models,  datasets, 
information  streams  and  users'?  How  can  these  network  components  provide 
interactive  real-time  response  for  multiple  low-  and  high-bandwidth  information 
streams  over  local  and  global  communications  networks'? 

•  Sonar  is  the  most  effective  detection  sensor  used  by  underwater  vehicles. 

Sonar  parameters  pertinent  to  visualization  and  rendering  include  sound  speed 
profile  (SSP),  highly-variable  sound  wave  path  propagation,  and  sound  pressure 
level  (SPL)  attenuation.  How  can  a  general  sonar  model  be  networked  to 
provide  real-time  re.sponse  despite  high  computational  complexity'?  How  can 
scientific  visualization  techniques  be  applied  to  outputs  of  the  sonar  model  to 
render  numerous  interacting  physical  effects  varying  in  three  spatial  dimensions 
and  time'? 

•  How  can  these  concepts  be  implemented  in  a  working  system'? 
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1).  dissp:rtati()n  organization 

The  real  world  is  a  big  place.  Virtual  worlds  must  also  be  comprehensive  and 
diverse  if  they  are  to  permit  credible  reproductions  of  real  world  behavior.  A  vaihety 
of  architectural  components  are  described  in  this  dis.sertation.  Ways  to  scale  up  and 
arbitrarily  extend  the  underwater  virtual  world  to  include  very  lai’ge  numbers  of  users, 
models  and  information  resources  are  included  throughout. 

Chapter  II  reviews  related  work  in  underwater  robotics,  robotics  simulation, 
underv  ater  vehicle  hydrodynamics,  robot  simulation,  computer  networking,  and 
scientific  visualization  of  .sonar  models.  Chapter  III  provides  precise  problem 
statements  and  solution  overviews,  both  for  the  general  dissertation  topic  as  well  as 
individual  virtual  world  components.  Chapter  IV  presents  the  functional  characteristics 
of  the  NPS  AUV,  the  underwater  robot  which  has  been  networked  with  the  underwater 
virtual  world.  Chapter  V  describes  die  requirements  and  design  decisions  made  in 
building  an  object-oriented  real-time  interactive  3D  computer  graphics  viewer. 

Chapter  VI  derives  novel  extensions  to  an  underwater  vehicle  hydrodynamics  model 
which  permit  real-time  networked  response,  standardized  nomenclature,  suitability  for 
parameterized  use  by  other  underwater  vehicles,  and  correctness  both  in  cruise  and 
hover  modes.  Chapter  VII  identifies  and  examines  the  four  network  capabilities 
necessary  for  scalable  and  globally  distributable  virtual  worlds.  Network 
considerations  include  both  tight  and  loose  temporal  coupling,  low-bandwidth  and 
high-bandwidth  information  streams,  audio,  video,  graphics,  multimedia,  posture 
updates  using  the  Distributed  Interactive  Simulation  (DIS)  protocol,  and  very  large 
numbers  of  connecting^  models  and  u.sers.  Chapter  VIll  outlines  a  general  .sonar 
model,  presents  an  example  geometric  sonar  model,  and  describes  how  scientific 
visualization  techniques  might  be  applied  to  render  the  large  set  of  important 
characteristic  values  which  describe  sonar'  behavior.  Chapter  IX  presents  experimental 
results  for  the  hydrodynamics  model  and  network  performance  during  distributed 
exercises.  Chapter  X  summai'izes  the  many  dissertation  conclusions  identified  in 
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preceding  chapters.  An  acronym  appendix  is  provided  for  reader  convenience.  Finally 
an  accompanying  video  appendix  documents  performance  of  the  NFS  AUV  operating 
in  the  underwater  virtual  world  and  presents  a  variety  of  exercise  scenarios. 

The  structure  of  the  accompanying  software  reference  (Brutzman  94e)  parallels 
the  organization  of  this  dissertation.  All  source  code,  support  files  and  compiled 
executable  programs  are  also  freely  available  via  Internet  access  using  anonymous  file 
transfer  protocol  (ftp)  access.  The  software  reference  includes  help  files  and  source 
code  for  archive  installation,  the  NFS  AUV  robot  execution  level,  3D  computer 
graphics  viewer,  hydrodynamics,  sonar  modeling,  networking,  and  use  of  the 
World-Wide  Web  (WWW)  and  Multicast  Backbone  (MBone). 
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11.  REVIEW  OF  RELATED  WORK 


A.  INTRODUCTION 

This  chapter  reviews  previous  and  current  research  pertinent  to  the  creation  of  an 
underwater  virtual  world  for  an  AUV.  While  no  other  underwater  virtual  worlds  were 
encountered  during  this  literature  search,  the  diversity  of  the  many  components 
developed  in  this  dissertation  invite  background  examinations  on  a  wide  range  of 
topics.  Subjects  examined  in  this  chapter  include  underwater  robotics,  robotics  and 
simulation,  dynamics,  networked  virtual  world  communications,  sonar  modeling  and 
visualization,  and  ongoing  and  future  projects.  In  order  to  avoid  becoming  open-ended 
surveys  of  entire  bodies  of  scientific  literature,  the  following  project  reviews  are 
limited  to  aspects  directly  pertaining  to  this  dissertation. 

B.  UNDERWATER  ROBOTICS 

The  AUV  research  community  is  small  but  steadily  growing.  Key  papers  in  this 
fi  'd  are  primarily  found  in  annual  conferences  (included  throughout  the  accompanying 
list  of  references)  which  reach  back  over  a  decade.  These  include  the  IEEE  Oceanic 
Engineering  Society  (OES)  Autonomous  U ndei'water  Vehicle  (AUV)  symposia  and 
OCEANS  conferences,  Unmanned  Untethered  Submersible  Technologies  (UUST) 
symposia,  and  International  Advanced  Robotics  Programme  (lARP):  Mobile  Robots 
for  Subsea  Environments  workshops.  A  recent  survey  of  previously  unknown  research 
submersibles  and  undersea  technologies  in  Ukraine  and  Russia  appears  in  (WTEC  93). 
Current  capabilities  in  remotely  operated  vehicle  (ROV)  operations  are  described  in 
(Newman  92-93).  A  survey  of  AUV  capabilities  emphasizing  potential  for  commercial 
deployment  appears  in  (Walsh  93-94).  A  detailed  description  of  the  NFS  AUV 
appears  in  Chapter  IV.  This  section  provides  an  overview  of  several  significant 
A  LI  Vs.  For  a  dynamic  view  of  underwater  robotics,  video  .segments  of  .state-of-the-art 
AUV  operations  appear  in  recent  video  conference  proceedings  (Brutzman  93a,  94a). 
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A  survey  of  all  AUVs  is  not  appropriate,  but  representative  and  pertinent  AUV 
projects  are  summarized  below. 

1.  AKPA/Navy  Unmanned  Undersea  Vehicle  (UUV) 

The  ARPA  UUV  program  began  in  1988  when  the  diaries  Stark  Draper 
Laboratories  were  contracted  to  build  two  large  UUVs  for  tactical  naval  missions, 


Figure  2.1.  ARPA/Navy  Unmanned  Underwater  Vehicle  (UUV)  being  readied  for 
launch  during  mission  trials  (Brancart  94)  (Brutzman  94a). 
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particularly  open-ocean  minefield  search.  These  vehicle.s  are  the  largest,  the  most 
capable  and  (at  approximately  $9  million  total)  the  most  expensive  AUVs  built  to  date. 
The  ARPA  UUVs  use  high-density  silver  zinc  batteries  for  24  hours  of  operational 
endurance  at  5-10  knots  submerged.  Weighing  15,000  pounds  in  air,  the  vehicles  have 
titanium  hulls  which  permit  a  test  depth  of  1,000  feet.  The  UUVs  successfully 
deployed  advanced  sonar  processors,  laser  communications  and  a  variety  of  other 
advanced  technologies  in  its  2()00-pound-capacity  payload  section.  Hybrid  simulation 
techniques  were  used  to  test  vehicle  hardware  and  software  prior  to  at-sea  deployment. 
Simulation  components  included  six-degree-of-freedom  hydrodynamics  and  tether 


dynamics  models,  along  with  hardware  subcomponent  models  and  wireframe  computer 
graphics.  Vehicle  overviews  can  be  found  in  (Pappas  91)  (Brancart  94),  and  extensive 
video  footage  of  various  testing  milestones  is  included  in  (Brutzman  93a,  94a). 


Figure  2.2.  ARPA/Navy  Unmanned  Underwater  Vehicle  (UUV)  internal  layout 
(Pappas  91). 


"In  March  1993.  the  [ARPAl  Maritime  Systems  Technology  Office  successfully 
completed  a  series  of  at-sea  te.sts  that  demonstrated  the  Mine  Search  System 
(MSS),  a  prototype  minehunting  system.  In  these  demonstrations,  a  ship  with 
the  UUV  in  the  lead  repeatedly  made  safe  transits  through  deep  and  shallow 
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mine  fields.  During  these  tiunsits,  bottom  mines  undetectable  by  ship-mounted 
sensors  were  readily  detected  by  the  UUV  sensors  optimally  positioned  with 
respect  to  the  target  mines...  These  demonstrations  clearly  showed  for  the  first 
time  the  value  of  UUV  sen.sors  in  a  mine  countermeasures  role." 

(from  Brancart’s  ARPA  abstract,  Brutzman  94a) 

The  ARPA  UUVs  have  been  first  to  accomplish  many  important  AUV 
tasks,  but  their  cost  is  high  and  technical  details  remain  out  of  the  published  literature. 
While  they  have  been  an  excellent  testbed  for  new  technologies,  the  high  cost  of 
vehicle  support  and  operations  places  them  beyond  the  reach  of  mo.st  research  efforts. 

2.  Massachusetts  Institute  of  Technology  (MIT)  Odyssey  Class  AllVs 

The  MIT  Underwater  Vehicles  Laboratory  Sea  Grant  College  Program  has 
been  building  and  deploying  a  .series  of  low-cost  AUVs  for  a  number  of  years 
(Bellingham  94)  (Fricke  94).  The  current  Odyssey  //,  predecessor  Odyssey  I  and 


Odystey  II  In  Arctic  conllguratlon 


HOPliouUr  Utrkig 


Qias*  praaaiK*  a()h*ra  with 
cgmpular  navigation  ttnooro 


Battary  ophort  with  powtr 
Msd  commuitlcotion*  bovdt 


Figure  2.3.  MIT  Odyssey  U  in  under-ice  configuration.  Deep-ocean  configuration 
includes  obstacle  avoidance  sonar,  strobe  light,  altimeter  sonar  and 
video  camera  (Bellingham  94). 


Sea  Squirt  vehicles  are  characterized  by  teardrop  hull  forms,  17"  glass  sphere  internal 
pressure  vessels,  low  power  consumption,  single  68030  microprocessor,  single 
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propeller  and  cruciform  stern  fin  control.  Vehicle  control  software  uses 
state-configured  layered  control  (Bellingham  90),  an  augmented  form  of  subsumptive 
control  (Brooks  Kfi.  90)  which  provides  a  higher  level  of  control  in  order  to  enable 
mission  configuration.  Odyssey  II  sensors  include  vai'ious  scanning  and  homing 
sonars,  depth  sen.sor.  temperature  salinity  and  related  sensors,  video,  inertial  sensors, 
acoustic  modem  and  acoustic  navigation  tracking  pingers.  Stable  dynamic  control  is 
constrained  by  a  minimum  forward  speed  of  0.5  m/.sec,  and  operational  missions 
follow  a  cruise  or  survey  profile.  Maximum  operating  depth  is  6,700  m.  Unit  costs 
remain  low  (utider  .liTS.OOO)  even  while  each  generation  of  vehicle  has  demonstrated 
significantly  improved  hardware  and  increc.sed  operational  capabilities.  Perhaps  the 
greatest  contributions  of  the  Odyssey  cla.ss  vehicles  have  been  in  demonstrating 
operational  mi.ssions  in  river.s.  in  open  ocean  and  under  the  Arctic  ice  (Bellingham  94) 
(Fricke  94)  (Brutzman  94a).  Future  work  includes  a  variety  of  oceanographic  missions 
using  innovative  sen.sors  (Bales  94a,  94b)  and  ocean  suiwey  communications  as  part  of 
a  proposed  Autonomous  Oceanographic  Sampling  Network  (AOSN)  (Curtin  93) 
(Catipovic  93). 

3.  Murine  Systems  Engineering  Laboratory  EAVE  Vehicles 

The  Experimental  Autonomous  Vehicle  (EAVE)  class  of  AUVs  first 
started  in  197H  when  EAVE  I  demonstrated  autonomous  underwater  pipe  following 
(Blidberg  90)  (Chappell  94).  Subsequent  missions  have  included  navigation  using 
acoustic  transponders,  submerged  structure  cleaning,  underwater  docking  and  pai'king, 
and  multiple  AUV  submerged  communication  and  mis.sion  coordination.  EAVE  class 
vehicles  aie  constructed  on  open  frames  using  large  watertight  cans  for  electronics  and 
electrical  components.  Sensors  include  a  variety  of  sonars,  compass,  temperature  and 
pressure  (depth)  detector,  inertial  sen.sors,  acoustic  modem  and  video.  The  Marine 
Systems  Engineering  Laboratory  (MSEL)  was  initially  located  at  University  of 
New  Hampshire  and  moved  to  Northeastern  University  in  1994.  Notable  contributions 
of  EAVE  research  include  implementing  multiple  level  .software  architectures,  multiple 
vehicle  interaction  protocols,  low-bandwidth  acoustic  communication  languages,  and 


Figure  2.4.  Marine  Sy.stems  Engineering  Laboratory  (MSEL)  Experimental 
Autonomous  Vehiele  EAVE  II  equipment  layout  (Blidberg  yO). 


unique  inis.sions  such  as  rapid-response  oil  spill  underwater  survey  (Brutzman  y3a). 


4.  Florida  Atlantic  University  (FAU)  Ocean  Voyager  II 

The  Ocean  Voyager  II  is  a  long-range  AUV  designed  for  coastal 
oceaiiogiaphy,  classifying  bottom  types  by  flying  at  a  constant  altitude  above  the  sea 
floor  while  measuring  bottom  albedo,  light  absorption  and  other  pai'ameters  (Smith  94) 
(Brutzman  y4a).  Results  of  lai'ge-aiea  surveys  will  be  used  to  calibrate  satellite 
measurements  which  currently  have  few  correlation  checks  available  with  ground  truth. 
The  possibility  of  rapid  response  means  that  this  AUV  mission  is  ahso  suitable  for 
tactical  oceanography.  Vehicle  hull  form  is  similar  in  size  and  shape  to  the  MIT 
Odyssey  vehicles,  as  are  most  components.  Navigation  is  by  ultra-short  and  long 
baseline  acoustic  networks,  doppler  water  velocity  log  and  differential  global 
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Figure  2,5,  Florida  Atlantic  University  Ocean  Voyager  11  (Sntith  94). 


positioning  system  (DGFi)).  Communications  ai'c  by  2400  Kbps  acoustic  modems  or  a 
towed  float  radio  frequency  (RF)  antenna  when  near  the  surface.  Vehicle  endurance  is 
50-100  km,  depth  rating  600  m,  and  speed  is  3-5  knots.  Vehicle  design  required 
1  year  and  $100,000  initial  expen, se,  with  sensor  payloads  comprising  over  half  of  the 
total  cost.  Collection,  correlation  and  evaluation  of  large  oceanographic  datasets  are 
good  candidate  applications  fur  an  underwater  virtual  world. 

5.  Monterey  Hay  Aquarium  Research  Institute  (MHARI) 

Ocean  rechnology  Testbed  for  Engineering  Research  (OTTER) 

In  1994,  Monterey  Bay  Aquarium  Re.search  institute  (MBARI)  and  the 
Stanford  Aerospace  Robotics  Laboratory  built  the  Ocean  Technology  Testbed  for 
Engineering  Re.search  [O'lTER)  AUV  as  a  testbed  for  vision-based  servoing  for  vehicle 
control  while  constructing  video  mosaics  of  the  ocean  floor  (Marks  92,  94a,  94b) 
(Brutzman  93a,  94a).  Stereo  video  cameras  provide  high-bandwidth  sti'eams  which  are 


Figure  2.6, 


Video  mosaic  from  Monterey  Bay  Aquarium  Research  Institute 
Ocean  Technology  Testbed  for  Tngineering  Research  (OTTER) 
(Marks  y4a,  y4b)  (Brutzman  y4a).  Note  fish,  upper  right  corner. 


sub.sampled  and  filtered  using  vision-processing  hardware  for  real-time  response.  As 
denionsiraied  by  (Marks  y4a),  sequentially  applying  a  signum  function,  a  Laplacian 
function  and  a  Gaussian  correlation  function  produces  images  which  can  be  adjusted 
fur  stereo  disparity  and  correlated  between  subsequent  Itames.  This  result  produces  an 
optic  flow  output  whicli  can  then  be  used  for  feature  tracking.  Once  a  feature  ha.s 
been  identified,  dynamic  feedback  to  thrusters/planes/propellers  controllers  permits  the 
OTTER  vehicle  to  follow  that  object  or  navigate  relative  to  the  bottom.  The  same 
correlation  algorithm  can  be  u.sed  to  match  physically  adjacent  images  into  a 
large-scale  video  mosaic  in  real  time,  often  providing  a  better  match  than  is  possible 
using  manual  methods.  Acoustic  tratusmittal  of  video  mosaics  is  possible  in  real  time, 
while  transmittal  of  unculled  video  is  infeasible  due  to  excessive  bandwidth 
requirements.  Both  object  (e.g.  sea  creature)  trucking  and  bottom  mapping  ai'e 
extremely  valuable  oceanographic  capabilities,  and  are  also  essential  if  AUVs  are  to  be 
jiractical  tools  for  ocean  exploration.  Video  mosaic  mapping  and  observation  of 
undersea  creatures  in  situ  are  fundamental  behaviors  for  automatic  data  collection  and 
underwater  virtual  world  databa.se  con.struction. 
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6.  Woods  Hole  Oceanographic  Institution  (WHOI) 

Autonomous  Benthic  Explorer  (ABE) 

The  Woods  Hole  Oceanographic  Institution  (WHOI)  has  designed  and 
constructed  a  special  purpose  AUV  fur  long-term  surveys  of  the  deep  ocean  floor 
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Figure  2.7.  Woods  Hole  Oceanographic  Institution  (WHOI) 

Autonomous  Benthic  Explorer  {ABE)  mission  profile  (Yoerger  94). 


(Yoerger  91,  94).  llie  A,utonomous  Benthic  Explorer  {ABE)  can  moor  at  a  fixed 
location  for  long  periods  of  time  in  a  "sleep"  mode  and  periodically  awake,  perfonn  a 
local  survey  by  navigating  within  a  short  baseline  acoustic  transponder  field  while 
measuring  water  parameters  and  taking  low  light  charge-coupled  diode  (CCD)  camera 
photographs,  then  reattach  to  the  mooring.  Power  consumption  is  extremely  low  in 
order  to  support  16  hours  of  maneuvering  endurance  spread  over  missions  lasting  up 
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to  a  your.  Science  missions  include  observation  of  deep  ocean  hydrothermal  vents  and 
bentltic  biologic  communities.  The  vehicle  is  retrieved  following  an  acoustic 
command  to  drop  ballast  and  return  to  the  surface.  ABE  operational  ranges  and 
endurance  can  be  significantly  increased  by  attaching  the  mooring  to  a  magnetic 
induction  power  transfer  device  and  acoustic  communications  relay.  Potentially  high 
data  rates  and  the  possibility  of  making  geologic  measurements  with  real-time 
importance  make  ABE  deployments  a  natural  application  to  be  networked  with  an 
underwater  virtual  world. 

7.  Explosive  Ordnance  Disposal  Robotics  Work  Package  (EOORWP) 

I’he  Lockheed  Explosive  Ordnance  Disposal  Robotics  Work  Package 
(E(3DRWi’)  is  a  UUV  designed  to  assist  divers  in  locating,  classifying  and  neutralizing 
underwater  mines  (Trimble  y4a,  y4b)  (Brutzman  94a).  Although  tethered  in  order  to 
provide  power  and  controller  communications,  the  EODRWP  has  a  sophi.sticated  suite 
of  rule-based  behaviors  to  intelligently  perform  signal  processing,  clas.sification, 
dynamics  control,  mission  planning  and  mission  execution  with  minimal  human 
supervision.  Shore-based  graphical  simulation  connected  to  vehicle  hardware  in  the 
laboratory  is  considered  an  essential  capability  and  is  used  to  visualize  and  test  tlte 
EODRWP  prior  to  at-sea  testing.  Particular  conti’ibutions  of  this  project  include 
guidance,  navigation,  conti'ol  and  mission  task  integration  of  human  and  robot.  Use  of 
an  underwater  virtual  world  combined  with  EODRWP  and  externally-conti'olled 
synthetic  humans  has  the  potential  to  improve  mine  neutralization  tactics  while 
letlucing  risks  to  navy  divers  and  ships. 
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Figure  2.8.  Lockheed  Explosive  Ordnance  Disposal  Robotics  Work  Package 
(EODRWP)  and  diver  (Trimble  94a,  94b)  (Brutzman  94a). 

8.  Miniature  AUVs 

With  exponentially  improving  price/performance  ratios  in  computer 
microprocessors,  it  is  natural  to  expect  that  miniature  AUVs  niight  provide  capabilities 
that  avoid  the  power  and  propulsion  handicaps  of  larger  vehicles.  The  Smart 
Communications  Syste'm  (SMARTCOMMs)  (Frank  94)  is  representative  of  such 
efforts.  As  fundamental  AUV  problems  of  low-power  sensing,  low-level  dynamics 
control  and  high-level  mission  contiol  are  resolved,  miniaturization  and  optimization 
of  vehicles  becomes  cost  effective.  It  is  likely  that  large  numbers  of  inexpensive  and 
moderately  capable  AUVs  will  become  available  in  the  near'  future.  Communicating 
with  and  coordinating  these  vehicles  in  the  context  of  massive  environmental  datasets. 
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numerous  data  streams  and  large  ocean  areas  will  be  a  significant  challenge. 
Networking  large  numbers  of  these  vehicles  within  an  underwater  virtual  world  can  be 
a  practical  solution, 

C.  ROBOTICS  AND  SIMULATION 

A  very  great  number  of  robotics- related  simulations  have  been  produced,  but  few 
involve  mobile  robotics.  Those  simulations  which  are  available  are  typically  restricted 
by  common  limitations  of  simulation:  problems  and  solutions  are  approached  in  a 
piecemeal  and  fragmented  fashion.  Thus  simulation  results  remain  susceptible  to 
failure  when  deployed  in  the  real  world  due  to  the  untested  complexity  of  multiple 
interacting  processes  operating  within  the  hard  real-time  constraints  of  unforgiving 
environments.  There  is  no  safe  and  complete  "practice"  environment  for  AUVs,  since 
test  tanks  cannot  reproduce  the  variability  of  critical  parameters  found  in  the  ocean, 
and  since  any  in-water  failure  may  lead  to  vehicle  damage  or  loss  due  to  flooding. 
Known  simulation  efforts  pertaining  either  to  AUVs  or  construction  of  robot-centered 
sirtual  worlds  follow. 

1.  NPS  AUV  Integrated  Simulator 

Re.search  preliminary  to  this  dissertation  established  "integrated  simulation" 
as  a  neces.sujy  tool  for  AUV  development  (Brutzman  92a,  92c,  92e)  (Compton  92). 
Integrated  simulation  was  identified  as  a  suite  of  simulation  tools  to  assist  in  the 
design  and  testing  of  all  vehicle  hai'dware  and  software  components.  An  integrated 
simulator  was  built  that  provided  real  world  functionality  and  visualization  for  a 
variety  of  Al-related  tactical  softwaie  programs.  Integration  of  simulation  throughout 
the  softwai'e  design  process  was  shown  to  have  tangible  benefits  in  producing  results 
that  might  otherwise  have  been  impossible.  Pertinent  work  preceding  that  thesis 
includes  (Jurewicz  90)  (Zyda  90)  (Healey  92a),  Confiimation  of  integrated  simulation 
conclusions  were  subsequently  reported  following  the  successful  development  of  the 
Multi-Vehicle  Simulator  (MVS)  with  the  Twin-Burger  AUV  (Kuroda  94) 

(Brutzman  94a). 
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Fij'ure  2.9. 


NFS  AUV  Integrated  Simulator  showing  playback  of  pool  mission  with 
autonomous  sonar  classification  expert  system  results 
(Brutzman  92a,  92c,  92e)  (Compton  92). 


Integrated  simulation  differs  significantly  from  the  virtual  world  produced 
in  this  dissertation  in  that  robot-specific  hardware  and  software  were  completely 
off-line,  real-time  response  was  not  required,  .simulation  models  were  not  connected  or 
networked,  simulations  were  single  user  programs  and  vehicle  hydrodynamics  response 
was  only  available  by  playing  back  in-water  test  results.  Developing  and 
implementing  the  concepts  involved  in  integrated  simulation  were  important 
prerequisites  to  conceiving  the  notion  and  defining  requirements  to  build  an 
underwater  virtual  world  for  an  AUV  (Brutzman  92d). 

2.  ARPA/Navy  UUV  Hybrid  Simulator 

The  ARFA/Navy  UUV  development  lab  at  Charles  Stark  Draper 
Laboratories  includes  a  simulator  which  consists  of  a  mainframe  computer,  models  of 
hydrodynamics  and  .sensor  respon.se,  and  highly  detailed  component-level  models  of 
individual  UUV  internal  equipment  (such  as  motor  electrodynamics  models) 

(Pappas  91)  (Brancart  94)  (Brutzman  93a,  94a).  A  Simulation  Interface  Unit  (SIU) 
provides  a  custom  hardware  interface  between  mainframe  computer  and  vehicle. 
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Mechanisms  are  also  provided  to  test  individual  vehicle  components.  At-sea  test  dive 
profiles  are  first  undertaken  in  the  laboratory  prior  to  operational  testing.  Wireframe 
graphics  provide  a  simple  rendering  of  vehicle  posture  during  hardwai'e-in-the-loop 
testing. 


Figure  2.10.  ARPA/Navy  Unmanned  Underwater  Vehicle  (UUV)  Hybrid  Simulator 
wireframe  graphics  rendering  of  hardware-in-tlie-loop  laboratory 
vehicle  tests  (Pappas  91)  (Brancart  94)  (Brutzman  93a,  94a). 


The  ARPA/Navy  UUV  Hybrid  Simulator  has  much  of  the  functionality 
needed  for  a  robot-based  underwater  virtual  world,  but  several  important  capabilities 
are  missing.  The  algorithms  and  source  code  for  the  hybrid  simulator  ai'e  not  publicly 
available  and  many  equipment  components  are  proprietary.  Since  all  software 
components  (including  computer  graphics)  are  in  a  single  loop  on  a  large  mainframe 
computer,  the  software  architecture  cannot  scale  up  indefinitely  with  the  addition  of 
new  world  models.  Graphics  are  particularly  bound  since  the  frame  rate  of  screen 
updates  are  tied  to  the  timing  of  the  robot/simulator  loop.  No  mechanisms  are 


provided  for  remote  networked  collaboration.  Overall,  the  ARPA/Navy  UUV  hybrid 
.simulator  is  one  of  the  best  of  all  "hardware  in  the  loop"  simulations,  where  computer 
simulation  and  target  system  are  closely  coupled  in  isolation  from  any  other  interaction 
methods.  The  ARPA  UUV  Hybrid  Simulator  constitutes  a  Uemendous 
accomplishment  which  provided  inspiration  and  points  of  comparison  for  several  parts 
of  this  work. 

3.  NASA  Ames  Intelligent  Machines  Group  (IMG): 

Telepresence  Remotely  Operated  Vehicle  (TROV) 

The  NASA  Ames  Intelligent  Machines  Group  (IMG)  has  worked  on  a 
variety  of  robots  and  human-computer  interface  devices  with  the  long-term  objective 


Figure  2.11.  NASA  Ames  Intelligent  Machines  Group  (IMG) 

Telepresence  Remote  Operated  Vehicle  (TROV)  (Hine  94). 
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of  providing  effective  telepresence  for  scientific  exploration  of  other  planetary 
surfaces,  such  as  on  Mars  (Hine  94).  Telepre.sence  is  defined  as  the  projection  of 
human  senses  into  remote  locations,  and  its  effectiveness  is  measured  by  the 
usefulness  of  telepresence  robotics  in  conducting  actual  scientific  investigations. 

Human  sense  of  presence  can  be  enhanced  by  virtual  reality  input/output  devices  (such 
as  headset  and  data  glove)  together  with  virtual  world  representations  combining 
interactive  3D  graphics  with  low-bandwidth  high-latency  network  links  to  remote 
robots.  In  1993  NASA  Ames  deployed  the  Telepresence  Remotely  Operated  Vehicle 
(TROV)  under  Ross  Sea  ice  near'  McMurdo  Science  Station,  Antarctica.  The 
underwater  vehicle  was  an  open-frame  Phantom  S2  ROV  with  four  thrusters,  stereo 
video  cameras,  a  gripper  manipulator,  oceanographic  sensors,  acoustic  transponder 
navigation,  four  commandable  degrees  of  freedom  and  1000  ft  depth  capability. 
Communication  with  the  TROV  was  via  a  twisted-pair  umbilical  tether  to  the  TROV 
controller  topside  and  then  using  Internet  Protocol  (IP)  packets  over  infrared 
(IR)  laser,  microwave  and  intercontinental  satellite  links.  This  varied  communications 
path  induced  significant  latencies,  albeit  .still  less  than  those  experienced  at 
interplanetary  distances.  The  Virtual  Environment  Vehicle  Interface  (VEVI)  modular 
operator  interface  for  direct  teleoperation  and  supervisory  (task-level)  conti'ol 
integrated  all  inputs  and  outputs,  including  a  head  device  for  steering  the  viewing 
cameras  and  incrementally  updated  graphics  models  for  terrain  and  other  pertinent 
physical  objects.  Science  teams  running  the  two-month  mission  focused  on  marine 
biology,  chemical  oceanography  and  benthic  ecology.  Science  objectives  were  met 
and  teleoperation  was  proven  feasible  from  a  variety  of  locations  around  the  globe. 
Stereo  displays  provided  excellent  depth  perception,  and  controller  time-delay 
modifications  for  task-level  control  and  predictive  teleoperation  response  proved 
successful.  Related  work  includes  the  DANTE  robot  exploration  of  the  Alaskan 
volcano  Mt.  Spurt  and  possible  regional  collaboration  in  deep  AUV  exploration  of 
Monterey  Bay.  TROV  is  representative  of  the  most  sophisticated  teleoperated  robots. 
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A  sui'vey  and  analysis  ot  telerobotics  capabilities  and  trends  appears  in  (Durlach  94). 
Principal  reference  in  the  telerobotics  field  remains  (Sheridan  92). 

4.  University  of  Hawaii:  Omni-Uirectional  Intelligent  Navigator  (ODIN) 

The  University  of  Hawaii  Omni-Directional  Intelligent  Navigator  (ODIN) 
project  combines  an  AUV  with  an  integrated  graphics  simulation  for  development  of 
adaptive  dynamics  control  algorithms  (Choi  94).  ODIN  is  a  small  spherical  AUV  with 


Figure  2.12.  University  of  Hawaii  Omni-Directional  Intelligent  Navigator  (ODIN) 
(Choi  94). 


a  single  manipulator  and  four  steerable  vertical  thrusters,  capable  of  posture  control  in 
six  degrees  of  freedom.  Primary  research  conducted  using  ODIN  concerns 
determination  of  hydrodynamics  coefficients,  linear  controllers,  nonlinear  controllers, 
and  adaptive  controllers  utilizing  fault  detection  and  automatic  reconfiguration  using 
neural  networks.  Integration  of  a  single  graphics  workstation  with  ODIN  demonstrates 
the  functionality  independently  described  in  the  NPS  AUV  Integrated  Simulator 
(Brutzman  92a,  92c). 
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5.  Tuohy:  "Simulation  Model  fur  AUV  Navigation" 

(Tuohy  94)  developed  a  simulation  model  to  test  AUV  navigation 
applications.  An  object-oriented  approach  organized  the  overall  simulation  model  into 
environmental  models  (consisting  of  terrain  and  water  column  maps)  and  physical 
object  models  (consisting  of  sensor,  command/program  and  dynamics  models). 
Contributions  of  this  work  include  a  proposed  general  model  partitioning  suitable  for 
vessels  and  static  structures,  emphasis  on  map  decomposition  using  spatial  data 
structures,  and  model  integration  with  3D  graphics. 

6.  Chen;  "Simulation  and  Animation  of  Sensor-Driven  Robots" 

(Chen  94)  describe  how  most  robotics  simulations  include  robot  and 
environment  while  excluding  .sensors,  and  identify  the  creation  of  realistic  simulation 
and  animation  softwaie  us  an  important  robotics  research  issue.  They  present  a  system 
for  simulation  and  animation  of  sensor-driven  robot  manipulators  and  indoor  mobile 
robots.  The  system  hierarchy  includes  models  for  robot,  tool  in  work  cell,  sensors  and 
physical  objects.  Physically-based  models  for  proximity,  point  laser  range,  laser  range 
depth  imagery  and  vision  intensity  sensors  are  included,  with  reseai'ch  continuing  on 
force/torque  and  tactile  sensors.  Three-dimensional  interactive  graphics  are  used  for 
robot  and  sensor  visualization,  although  real-time  performance  is  not  guaranteed. 
Robots  can  be  integrated  into  the  simulation  system  to  permit  running  in  real  mode  or 
virtual  mode,  either  interactively  or  through  recording  playback.  In  real  mode,  robot 
controller  subsystem  electronics  are  physically  connected  to  ports  on  the  simulating 
workstation  for  two-way  communication  of  command  and  sensor  information,  hi 
virtual  mode,  robot  software  is  run  on  the  same  workstation  as  the  computer  graphics, 
independently  of  robot  hardware.  Primary  conclusion  of  this  work  is  that  a  simulator 
for  an  integrated  sensor-driven  robotic  sy.stem  must  incorporate  simulation  of  sensory 
information  feedback.  Planned  future  work  includes  incorporation  of  a 
voice-recognition  module  in  the  robot  and  adding  dynamic  models  to  other  objects  in 
the  simulation  environment. 
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7.  Yale  University:  Ars  Magna  Abstract  Rubut  Simulator 

The  Ars  Magna  mobile  robot  simulator  provides  an  abstract  planaj  world 
ill  which  a  A1  planner  is  able  to  conti'ol  the  movement  of  a  mobile  robot 
(Engelsoii  92).  The  objective  of  the  simulator  is  to  provide  a  more  challenging  and 
realistic  environment  for  developing  and  evaluating  planning  systems  than  was 
previously  available.  Vehicle  motion  is  purely  kinematic  and  is  based  on  a  single 
point.  Simulated  manipulators  are  included.  Sensor  values  are  provided  by  geometric 
range  models  with  adjustable  noi.se  distributions.  Robot  planning  programs  ai'e  written 
in  a  variant  of  the  Lisp  programming  language.  The  useful  but  limited  capabilities  of 
the  Ars  Magna  are  representative  of  most  other  robot  simulators  currently  in  u.se. 


I).  UNDERWATKK  VEHICLE  DYNAMICS 

I’lie  study  of  dynamics  and  physics-based  motion  has  long  been  recognized  as  a 
necessary  prerequisite  fur  realistic  computer  graphics  rendering  and  valid  robotics 
performance  modeling.  Altliough  numerous  articles  pertaining  to  underwater 
hydrodynamics  exist,  almost  without  exception  they  focus  on  some  small  a.spect  of 
hydrodynamics  performance.  A  complete  hydrodynamic  model  suitable  for  real-time 
simulation  response  has  not  been  available  prior  to  this  dissertation.  An  overview 
comparison  of  dynamics  models  in  different  environments  appears  in  the 
hydrodynamics  chapter.  In  this  section  key  references  preceding  the  new 
hydrodynamics  model  are  identified. 


1.  Healey:  Underwater  Vehicle  Dynamics  Model 

An  earlier  underwater  vehicle  hydrodynamics  model  presented  in 
(Healey  92c,  93)  provided  the  fundamental  basis  for  the  general  hydrodynamics  model. 
Strengths  of  the  model  included  theoretical  rigor,  completeness  for  cruise  operations 
using  propeller.s/rudders/plane  surfaces,  and  several  years  of  empirical  testing  which 
produced  an  initial  working  set  of  hydrodynamics  coefficients.  Limitations  include 
missing  terms  for  thruster  forces  and  moments,  missing  terms  for  low-speed  hovering 
drags,  extraneous  terms  corresponding  to  an  unusual  vehicle  configuration,  and  an 
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arrungemeiit  of  multiple  differential  equations  not  easily  adapted  to  real-time  temporal 
integration.  Further  detaihs  are  provided  in  Chapter  VI.  Of  all  dynamics  models 
examined,  this  was  by  fur  the  best.  Work  presented  in  this  dis.sertation  extends  and 
generalizes  that  fundamental  contribution. 

2.  Fossen:  Guidance  and  Control  of  Ocean  Vehicles 

Numerous  texts  exist  on  marine  vehicle  dynamics,  most  notably 

(Lewis  8S).  but  their  focus  is  almost  exclusively  on  surface  ships.  (Fossen  04) 
provides  a  thorough  treatise  on  both  surfaced  and  submerged  vehicle  dynamics  and 
control.  He  al.so  examines  stability,  ocean  modeling  of  wind  and  wave.s,  and  advanced 
control  techniques.  Theoretic  derivations  and  explanations  are  provided  tliroughout. 

Of  relevance  is  that  (Fus.sen  04)  includes  a  total  of  three  example  underwater  vehicle 
hydrodynamic  models:  two  simplified  linearized  models  (each  by  Healey)  and  the 
verbatim  original  six-degree-of-freedom  model  of  (Healey  03). 

3.  ARFA/Navy  UUV  Hydrudynamics  Simulatiun 

The  Navy/ARFA  UUV  design  and  development  team  has  reported  using  a 
full  six-degree-of-freedom  hydrodynamics  model  for  development  and  testing  of 
sophisticated  vehicle  controllers  (Pappas  01)  (Brancail  04).  Further  details  have  not 
been  published  publicly. 

4.  Vuli;  "  Modeling  and  Control  of  Undci'water  Kubutic  Vehicles" 

(Yuh  00)  provided  an  important  contribution  to  the  underwater  vehicle 
hydrodynamics  literature.  Although  presented  as  an  remotely-operated  vehicle  (ROV) 
model,  it  is  pertinent  to  any  type  of  underwater  vehicle.  He  describes  "added  mass" 
and  most  other  relevaiU  terms.  Nomenclature  and  algebraic  differences  make  this 
model  different  but  still  close  to  tiie  (Healey  93)  model  de.scribed  earlier. 

5.  U.S.  Navy  Submarine  Hydrodynamics 

The  subject  of  U.S.  naval  submarine  dynamics  is  clas.sified  and  was  not 
considered  during  this  work.  Some  open  literature  exi.sts.  (Jackson  92)  provides  an 
overview  of  the  basic  submarine  design  process,  examining  general  requirements  and 
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Ilow  design  tradeoffs  must  be  weighed.  (Gertler  67)  and  (Feldman  79)  present  the 
general  form  of  dynamics  equations  and  coefficient  nomenclature,  closely  conforming 
to  the  standard  mechanical  engineering  reference  (Lewis  88).  No  claims  or 
suppositions  regarding  any  classified  work  are  made,  implied  or  conjectured  in  this 
dissertation. 

K.  NEl  WORKED  COMMUNICATIONS  FOR  VIRTUAL  WORLDS 

Networking  considerations  in  the  construction  of  virtual  worlds  have  gained 
increasing  importance  in  recent  years.  As  virtual  worlds  grow  in  complexity  and 
quantity  of  information  repre.sented,  the  ability  to  scale  up  and  accommodate 
arbiuaiily  large  numbers  of  information  sources  and  interacting  entities  becomes  a 
crucial  requirement.  Currently  there  are  many  bottlenecks  preventing  unlimited  and 
seamless  virtual  world  communications.  Research  in  this  area  is  very  active 
(Zyda  95).  Multica.st  network  protocols  are  a  fundamental  development  in  this  regard 
and  are  examined  further  in  Chapter  VII.  This  section  examines  recent  work  in 
networking  virtual  worlds  with  an  emphasis  on  scalability  considerations. 

1.  SlMulutiun  NETworking  (SIMNET)  Architecture 

SIMNET  was  the  first  architecture  that  permitted  large  numbers  of 
simulated  entities  to  interact  together  in  real  time,  using  heterogenous  hosts  and 
disuibuted  communications  over  a  network  (Calvin  93).  With  over  ten  years  of 
development  and  operation,  SIMNET  is  a  proven  .system.  Key  design  principles  aie 
that  objects  interact  in  the  virtual  world  by  communicating  events,  all  objects  must 
relay  valid  data,  network  bandwidth  is  reduced  by  only  transmitting  state  changes,  and 
dead  reckoning  algorithms  are  used  to  predict  intermediate  postures.  Enabling 
technologies  for  SIMNET  were  real-time  computer  graphics  (image  generators), 
disuibuted  dynamic  and  static  virtual  world  databases,  , semi-automated  forces  (SAF) 
which  provide  realistic  entity  or  aggregate  force  behaviors,  high  speed  local  ar'ea 
networks  (LANs)  coupled  with  an  interaction  protocol,  and  free  choice  of 
human-computer  interfaces.  SIMNET  effectiveness  in  Ai’my  tactical  team  training  for 
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combat  has  been  documented  on  many  occasions,  such  as  the  Battle  of  73  Easting 
during  the  Iraci  war  (Calvin  93).  The  biggest  theoretical  success  of  SIMNET  has  been 
implementation  of  the  interaction  protocols,  which  became  the  foundation  for  the  DIS 
protocol  (IEEE  94a,  94b).  As  might  be  e.\pected  with  any  first-generation  sy.stem 
there  are  some  problems  with  the  SIMNET  architecture  concerning  scalability,  many 
of  which  are  addres.sed  by  ongoing  DIS  protocol  development  efforts.  SIMNET 
protocols  do  not  u.se  Internet  Protocol  .services,  but  instead  require  root  superu.ser 
permissions  for  execution  since  they  access  hardware  interfaces  at  the  data  link  layer 
directly.  In  practice  SIMNET  capacity  is  limited  to  300  simultaneous  players 
(Uurlach  94). 

2.  Distributed  Interactive  Simulation  (DIS)  PrutueuI 

The  DIS  protocol  is  an  approved  IEEE  standard  for  communications 
between  entities  in  small  or  large  scale  virtual  environments  (IEEE  93).  From  the 
recent  propo.sed  DIS  standard  revision: 

"Distributed  Interactive  Simulation  (DIS)  is  a  govemment/industry  initiative  to 
define  an  infrastructure  fur  linking  simulations  of  various  types  at  multiple 
locations  to  create  realistic,  complex,  virtual  ’worlds’  for  the  simulation  of 
highly  interactive  activities.  This  infrasU'ucture  brings  together  systems  built  for 
separate  purposes,  technologies  from  different  eras,  products  from  various 
vendors,  and  platforms  from  vai'ious  seiwices  and  permits  tliem  to  interoperate. 

DIS  exerci.ses  are  intended  to  support  a  mixture  of  vhdual  entities 
(human-in-thc-loop  simulators),  live  entities  (operational  platforms  and  test  and 
evaluation  sy.stems),  and  con.sti'uctive  entities  (wargames  and  other  automated 
simulations)."  (IEEE  94a,  94b) 

The  principal  type  of  interaction  in  DIS  is  U'ansmission  of  entity  state 
information  via  Protocol  Data  Units  (PDUs)  which  include  position,  orientation,  time 
and  (optional)  velocity  and  acceleration  values.  A  vai'iety  of  standardized  dead 
reckoning  algorithms  are  available  to  maximize  posidonal  infonnation  transfer  while 
minimizing  bandwidth  consumed.  Numerous  other  PDU  types  are  included  which 
relate  to  exerci.se  management,  collisions,  sensor  emissions,  and  entity  interactions 


such  us  wcaiH)ns  lire  and  logislic  support.  Free  unci  conirnercial  DIS  soltware  libraries 
are  available.  The  DIS  protocol  development  community  is  very  active  and  DIS 
continues  to  evolve.  Current  el’forts  are  focu.scd  primarily  on  supporting  larger 
numbers  of  simultaneous  entities,  and  also  on  extending  DIS  functionality  to  support 
additional  world  information  such  as  environmental  effects  and  distributed  terrain 
databa.ses  (lEliB  94a.  94b). 

3.  NFSNKT 

NFSNET  is  a  networked  virtual  environment  for  battlefield  simulation. 

Key  strengths  are  high  performance,  a  distributed  software  architecture,  ability  to 


I’igure  2.13.  NFSNET-IV  virtual  battlefield  showing  multiple  active  DlS-based 
entities,  textured  terrain  and  atmospheric  effects  running  at  high 
frame  rates  in  real  time  (Pratt  93,  94b)  (Zyda  93b). 
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handle  lai'ge  numbers  (hundreds)  of  interacting  human  and  autonomous  entities  in 
real  time,  initial  implementation  of  multicast  DIS  libraries,  public  di.suibution,  and 
insertion  of  remotely-controlled  synthetic  human  models  in  virtual  environments. 
NPSNET  has  over  one  hundred  institutional  u.sers  and  has  been  a  key  component  in 
numerous  large-scale  Army  simulation  exerci.ses.  NPSNET  is  likely  the  broadest  and 
highest-performance  virtual  environment  softwai'e  that  currently  exists.  Software 
disU'ibutions  are  free  to  registering  u.sers.  Ongoing  re.search  efforts  include 
object-oriented  techniques  for  virtual  environment  construction,  application  level  and 
network  level  communication  protocols,  hardware  and  operating  system  optimization, 
real-time  physically-ba.sed  modeling  (e.g.  .smoke,  dynamic  ten’ain  and  weather), 
integration  of  multimedia,  A1  for  autonomous  agents,  integration  of  analytic  models 
such  as  JANUS,  and  human  interface  design  (e.g.  stereo  vision  and  system  controls) 
(Pratt  93,  94a.  94b)  (Macedonia  95b)  (Zyda  93a,  93b). 


4.  Macudunia:  "Exploiting  Reality  with  Multicast  Groups" 

Although  DLS  can  scale  to  permit  simulation  exercises  with  several 
hundred  interacting  entities,  several  bottlenecks  constrain  current  DIS  network 
implementations  from  going  much  higher.  This  is  a  problem  since  di.stributed 
simulations  accommodating  tens  of  thou.sands  of  active  entities  are  needed.  One  key 
difficulty  is  that  par  ticipating  hosts  must  listen  to  every  DIS  report,  a  requirement  that 
eventually  consumes  all  host  processing  cycles.  (Macedonia  95a,  95b,  95c)  proposes 
partitioning  the  communications  space  into  more  manageable  streams  through  the 
considered  use  of  multicast  channels.  Since  multicast  packets  can  be  collected  or 
discarded  using  network  interface  hardwar’e  at  the  data  link,  layer,  hosts  need  only 
process  DIS  traffic  corre,sponding  to  subscribed  multicast  channels.  Large-scale  virtual 


worlds  can  thus  be  partitioned  according  to  geographic  space  subdivisions,  functional 
classes  (such  as  radio  frequencies),  and  temporal  clas.ses  (such  as  normally  static 
buildings  or  highly  dynamic  jet  aircraft).  Development  of  area  of  interest  management 
protocols  thus  becomes  necessary  for  retaining  complete  state  corresponding  to  a  given 
channel,  providing  a  state  snapshot  to  newly  joining  entities,  and  handing  off  coaU'ol 
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to  another  manager  if  necessary.  Protocol  extension  implementation,  experimentation 
and  analysis  is  in  progress.  The  capability  to  use  multicast  protocols  will  be  required 
for  future  DIS  compliance  (IEEE  94a),  underscoring  the  importance  of  these  concepts. 
These  ideas  are  explained  within  the  larger  context  of  .state-of-the-art  trends  in  virtual 


reality  networking  and  communications  in  (Durlach  94). 


Figure  2.14.  "Exploiting  Reality  with  Multicast"  -  multiple  DIS  channels  for 
geographic  sectors,  functional  classes  (e.g,  communications)  and 
temporal  classes  (e.g.  highly  dynamic  aircraft)  (Macedonia  95a), 


5.  (Jelernter:  Mirror  Worlda  and  Linda 

(Gelernter  92a,  92b)  describes  a  powerful  set  of  abstractions  for  networked 
virtual  world  communications.  He  extends  and  simplifies  the  message-passing 
paradigm  u.sed  by  communicating  softwai'e  objects  through  creation  of  a  "tuple  space." 
Tuples  ai'e  persistent  messages  without  a  specific  addressee.  Tuples  are  ordered  li.sts 
that  begin  with  some  keyword  and  contain  any  number  of  additional  elements. 
Processes  have  three  operations  to  use  with  tuples:  Jettison,  grab  and  read 
(alternatively  publish,  consume  and  nondesmuctive  read).  Processes  can  access  tuples 
by  pattern  matching  against  any  or  all  potential  tuple  elements,  thus  retrieving 
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individual  tuples  or  groups  of  tuples.  Tuple  space  consists  of  these  persistent  tuples 
being  read  and  generated  by  information  machines  (i.e.  proces.ses),  somewhat  .similar 
to  a  blackboard  architecture.  Since  tuple  elements  might  be  further  tuples,  and 
because  tuples  can  them.selves  be  programs,  recursive  hierarchies  and  distributed 
processing  are  natural  possibilities  without  explicit  specification  by  the  original 
programmer.  This  communication  methodology  has  also  been  shown  to  be  identically 
portable  to  massively  parallel  processors,  permitting  programmers  to  concentrate  on 
developing  parallel  algorithms  for  problem  solving  rather  than  tuning  the 
idiosyncracies  of  the  underlying  haidwaie  (Gelernter  92b). 

These  concepts  define  the  chui'acteristics  of  coordination  languages,  which 
extend  computational  programiriing  languages  in  a  general  and  orthogonal  way 
{Gelernter  92b).  Arguably  coordination  languages  provide  the  ability  to  scale  up  the 
number  of  interacting  computational  processes  to  a  degree  that  can  reflect  real  world 
functionality;  hence  "mirror  worlds"  (Gelernter  92a).  Initial  implementation  of  these 
ideas  is  demonstrated  by  the  Linda  communication  system  (Carriero  91) 

(Gelernter  92a,  92b).  As  virtual  worlds  continue  to  grow  and  network  bottlenecks 
l^ermit  much  larger  numbers  of  entities  to  interact,  implementing  the  functionality  of 
nonhierarchical  nonimperative  distributed  communication  schemes  as  described  in 
Minor  Worlds  will  be  essential. 

6.  Distributed  Interactive  Virtual  Environment  (DIVE) 

Distributed  Interactive  Virtual  Environment  (DIVE)  is  a  heterogeneous 
distributed  world  repre.sentation  that  shares  copies  of  a  world  database  to  permit 
multiple  u.sers  and  applications  to  simultaneously  interact  in  a  .single  virtual  3D  space 
(Carlsson  93).  The  world  database  seiwes  as  a  global  memory  shared  over  the  network 
using  a  reliable  ordered  multicast  scheme.  Maintaining  global  database  consistency  is 
an  important  problem  in  large-scale  virtual  worlds.  Multicast  protocol  packet  delivery 
is  ordinarily  "best  effort"  and  not  guaranteed.  Including  .sequential  numbers  to  each 
message  can  achieve  reliability  for  multicast  through  reti'ansmission,  but  the  cost  of 
that  error  recovery  is  expensive  and  such  approaches  (as  exemplified  by  DIVE) 


32 


currently  do  not  scale  past  several  dozen  peers  (Macedonia  95c).  Static  and  dynamic 
distributed  databases  are  another  key  bottleneck  that  must  be  addressed  for  arbitrarily 
sealable  virtual  worlds. 

7.  Other  Network  Communication  Systems  for  Virtual  Worlds 

Many  other  active  reseai'ch  projects  are  working  on  eliminating  the  barriers 
which  prevent  arbitrarily  scaling  up  di.stributed  virtual  world  communications. 
Recommended  references  are  (Zyda  95)  (Singh  94)  (Bricken  94)  (Shaw  93) 

(Morrison  95)  (Codella  93)  (Kazman  93).  Overlapping  and  interdependent  areas  of 
investigation  include; 

•  peer-to-peer  versus  client-server  models 

•  network  bandwidth  reduction 

•  network  processing  reduction  for  participating  hosts 

•  reliable  versus  best-effort  delivery 

•  object-oriented  functional  partitioning 

•  parallelization  to  improve  performance 

•  decoupling  user  interfaces  (input  devices  and  output  graphics) 

•  persistent  and  coherent  distributed  global  database  management 

•  open  toolkit  construction 

•  compatibility  over  heterogenous  platforms,  peripheral  hardware  independence 

•  operating  system  modifications  for  improved  performance 

•  defining  temporal  relations,  establishing  synchronization 

•  application  interaction  protocols 

Aside  from  the  common  denominator  of  Internet  Protocol  (IP)  use  and 
occasional  compliance  with  the  Distributed  Literactive  Simulation  (DIS)  application 
I  ■  uKol.  there  is  little  direct  compatibility  among  any  of  the  aforementioned 
.ipproaches.  Even  if  a  "silver  bullet"  solution  were  to  emerge  from  tliese  many  efforts, 
cuneiit  virtual  worlds  are  likely  to  remain  isolated  as  closed,  incommunicado  islands 
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of  functionality.  General  requirement.s  for  open  interoperability  between  virtual  worlds 
are  examined  in  (Breant  94).  Specification  and  development  of  a  .specific  open 
communications  model  as  an  exten.sion  of  World-Wide  Web  (WWW)  is  a  goal  of  the 
Virtual  Reality  Modeling  Language  (VRML)  working  group  (Bell  94)  (Pesce  94).  A 
commonly  accepted  baseline  interaction  model  for  virtual  world  communications  is 
needed. 

F.  SONAR  MODELING  AMD  VISUALIZATION 

Sonar  modeling  attempts  quantify  and  predict  the  highly  variable  behavior  of 
sound  waves  underwater.  A  large  number  of  sonar  models  have  been  in  use  since 
sonar  was  fir.st  widely  employed  in  the  iy4Us,  and  development  of  effective  sonar 
models  is  the  subject  of  ongoing  research.  Sonar  visualization  is  the  application  of 
scientific  visualization  techniques  for  rendering  sonar  information,  in  an  attempt  to 
better  understand  the  temporal,  spatial  and  physical  behavior  of  underwater  acoustics. 

It  is  a  relatively  new  area  of  study.  This  section  identifies  prominent  related  work  in 
sonar  modeling  and  sonar  visualization. 

1.  Etter:  Acoustic  Modeling 

(Etter  91)  presents  a  comprehensive  treatment  of  underwater  acoustic 
modeling,  defined  as  "the  translation  of  our  physical  understanding  of  sound  in  the  sea 
into  mathematical  formulas  solvable  by  computers."  He  first  treats  the  physics  of 
underwater  sound  and  acoustical  oceanography,  s’ynopsizing  another  key  reference  on 
sonar  behavior  (Urick  83).  Sound  speed  in  the  ocean  is  identified  as  the  single  most 
important  acoustic  valuable.  Etter  then  identifies  three  broad  classes  of  sonar  models 
and  organizes  the  wide  variety  of  existing  sonar  models  into  a  conceptual  hierarchy, 
shown  in  Figure  2.15.  Each  model  type  is  examined  in  depth.  There  is  no  "perfect" 
sonar  model  suitable  to  all  situat'  ns,  and  users  must  carefully  choose  models  (or 
combinations  of  models)  based  on  problem  requirements.  Typically  models  become 
less  general  and  more  specific  to  individual  sonar  systems  as  one  proceeds  up  the 
hierarchy. 
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Figure  2.15  Generalized  relationships  among  Environmental  Models,  Basic 

Acoustic  Models  and  Sonar'  Performance  Models  (Etter  91,  p.  3). 

The  three  types  of  models  identified  are  Envu'onmental  Models,  Basic 
Acoustic  Models  and  Sonar'  Performance  Models.  Envir'onmental  Models  examine 
ocean  surface  and  bottom  boundar'y  conditions  as  well  as  volumeti'ic  effects.  Basic 
Acoustic  Models  represent  the  physics  or  empirical  behavior  of  noise,  reverberation 
and  propagation  (transmission  loss).  Sonar'  Performance  Models  combine  signal 
processing  theory  with  the  preceding  Environrnental  Models  and  Basic  Acoustic 
Models  to  enable  end-to-end  solution  of  typical  sonax  detection  problems  particular  to 
speciiic  types  of  sonar  equipment. 

The  field  of  sonar  modeling  is  chai'acterized  by  tremendous  variety.  Most 
models  have  very  narrow  domains  of  applicability  and  may  need  to  be  used  in 
combination  with  others  for  the  solution  of  specific  problems.  Management  of  this 
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complexity  has  even  led  to  the  development  of  model  operating  systems  (MOSs) 
which  attempt  to  assist  users  by  managing  the  selection  of  multiple  models  and 
appropriately  connecting  their  various  input/output  requirements.  Initial  examination 
of  the  subject  of  sonar  modeling  from  the  perspective  of  underwater  virtual  world 
construction  identified  this  plethora  of  models  as  a  key  obstacle  to  scalability  and 
generality.  This  difficulty  is  compounded  by  the  fact  that  many  models  ai'e  reported 
to  be  classified  (Etter  91)  and  unavailable  for  use  in  an  open,  arbitrarily  .scalable 
virtual  world. 

2.  Stewart:  Stucliastic  Uackprujectiun  and  Sunar  Visualizatiun 

(Stewart  88)  presents  a  novel  approach  to  modeling  underwater  objects. 
Sonar  data  are  typically  high-bandwidth  high-noise  information  streams  that  include 


Figure  2.16. 


Graphics  visualization  of  JASON  ROV  approaching  submerged 
wreck  HMS  SCOURGE  (Stewai't  92). 


redundant  returns  from  target  of  interest,  as  well  as  a  large  proportion  of  signal 
corresponding  to  false  returns  or  objects  of  little  interest.  Key  characteristics  of 
underwater  sensing  applications  include  "real-time  constraints;  unstructured, 
three-dimensional  terrain;  high-bandwidth  sensors  providing  overlapping,  redundant 
coverage;  lack  of  prior  knowledge  about  the  environment;  and  inherent  inaccuracy  in 
sensing  and  interpretation."  Sonar  and  other  sensor  returns  are  treated  as  probability 
disu'ibutions  which  are  adaptively  combined  to  create  3D  maps  of  terrain  and  object 
surfaces  using  a  new  statistical  technique,  stochastic  backprojcction.  Model 
representation  accuracy  and  certainty  improve  as  redundant  data  accumulates. 
Intermediate  results  are  available  and  steadily  improve  in  real  time,  permitting 
"anytime"  u.se  by  operators  or  robots.  Reduction  of  bandwidth  and  extraction  of  useful 
information  are  also  significant  benefits.  Stochastic  backprojcction  is  appropriate  for 
use  in  bathymetric  mapping,  ROV  piloting  control,  and  world  modeling  for  AUVs, 

Sonar  visualization  techniques  were  essential  to  the  successful  development 
of  stochastic  backprojcction  methods,  .since  qualitative  visual  inspection  of  results  were 
used  to  evaluate  model  effectiveness.  In  addition  to  the  sonar  visualization  techniques 
presented  in  (Stewart  XH),  an  illustrated  survey  of  underwater  visualization  in 
(Stewart  92)  supplemented  by  (Stewai't  89,  91)  and  (Rosenblum  93)  presents  a 
thorough  state-of-the-art  summai'y  of  .sonar  visualization  and  underwater  sensor  visual 
repre.sentations. 

3,  Ziomek:  Recursive  Ray  Acoustics  (RRA)  Algorithm 

As  previously  noted,  a  key  difficulty  in  sonar  modeling  as  applied  to 
underwater  virtual  world  use  is  the  very  large  numbers  of  models  that  are  available  for 
different  ocean  conditions  and  different  sonars.  The  Recursive  Ray  Acoustics  (RRA) 
algorithm  (Ziomek  93,  94)  provides  an  approach  which  appeal's  to  be  general  and 
well-suited  for  real-time  graphics  rendering.  A  ray  tracing  algorithm,  RRA  derives  the 
fundamental  wave  equations  de.scribing  sound  propagation  from  a  differential  equation 
form  to  a  difference  equation  form.  Three-dimensional  models  for  sound  speed  profile 
(SSP)  and  terrain  bathymetry  are  retained  as  independent  inputs.  The  algorithm  is  fast 
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Figure  2.17,  Example  Recursive  Ray  Acoustics  (RRA)  algorithm  plot  showing 
sound  ray  bending  due  to  vertical  and  down-range  sound  speed 
profile  (SSP)  variations  (Ziomek  y3). 

since  each  short  ray  segment  in  a  long  ray  path  is  calculated  recursively  based  on  the 
ray  segment  preceding.  RRA  can  be  used  to  calculate  position,  propagation  angles, 
sound  pressure  level  (SPL)  and  ti'avel  time  along  a  ray  path.  Most  significantly  it 
appeal's  to  be  applicable  over  a  wide  range  of  frequencies  since  approximations  and 
empirical  simplifications  are  avoided  in  the  original  RRA  derivation.  Comparison  of 
RRA  results  with  different  models  validated  in  a  variety  of  problem  domains  has  been 
excellent.  RRA  appears  to  be  a  general,  precise  and  rapid  algorithm  suitable  for 
real-time  sonar  modeling  and  visualization. 

4.  Additional  Work  in  Sonar  Visualii;ation 

(Rosenblum  93)  presents  an  ovei'view  of  cuiTent  work  relating  to  sonar 
visualization,  Additional  images  and  explanation  appeal'  in  (Rosenblum  92) 
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(Kamgai'-Py.rsi  92).  (Karahalio.s  91)  examine.s  volumeti'ic  sonar  visualization  concepts 
and  presents  example  visualizations  using  near-field  sonar  processing  data.  Additional 
images  from  her  Vv'ork  appeal'  in  (Keller  93.  p.  122).  A  summary  of  underwater 
acoustic  models  which  includes  example  sonar  visualizations  is  (Porter  93). 

Wireframe  sonar  visualization  is  included  in  simulated  AUV  use  of  rnine  avoidance 
tactics  in  (Hyland  93).  Occupancy  grid  methods  presented  in  (Elfes  86)  are  further 
considered  in  (Auran  95).  A  vaiiety  of  2D  line  drawings  which  incoiporate 
uncertainty  information  appears  in  (Leonard  92).  Scientific  visualization  techniques 
applied  to  the  display  and  inteipretation  of  very  laige  environmental  datasets  appear  in 
(Rhyne  93a,  93b). 

(L  ()N(,()IN(J  AND  FUTURE  PROJECTS 

Directions  taken  in  this  work  have  also  considered  current  and  future  efforts 
which  might  benefit  from  an  underwater  virtual  world  approach.  Tfie  following 
projects  represent  many  diverse  and  fascinating  research  ai'eas  which  might  benefit 
from  connection  to  a  distributed  underwater  virtual  world  ai'cliitecture. 

1.  JASON  ROV  and  the  Jason  Project 

The  JASON  remotely  operated  vehicle  (ROV)  has  been  u.sed  to  conduct 
scientific  exploration  on  a  wide  range  of  oceanographic  and  historic  sites  of  interest 
(Ballard  93),  including  investigation  of  benthic  chemosynthetic  tubeworm  communities 
and  discovery  of  HMS  TITANIC.  Deep  ocean  investigations  using  JASON  aie 
supported  by  a  surface  ship  with  a  control  van,  as  well  as  the  intermediate  tow  sled 
MEDEA  which  provides  lights  and  local  decoupling  from  long  tailing  tethers.  In 
addition  to  power  and  control  signals,  the  use  of  fiber  optics  permits  U'ansmission  of 
high-bandwidth  sensor  and  video  data  from  vehicle  to  support  ship. 

In  1989  the  JASON  Foundation  for  Education  was  formed  to  utilize 
.scientific  exploration  missions  best  exemplified  by  the  JASON  ROV  as  a  catalyst  and 
central  focus  for  widely  distributed  distance  learning  (Brown  93).  JASON  Project 
missions  are  held  annually.  Students  first  learn  about  .science  objectives  in  detail 
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riyure  2.18,  Ja.son  ROV  mission  profile  and  JASON  Project  communications 
liiiKS  (Brown  93). 

during  regular  classes,  and  then  observe  and  participate  in  the  expedition  as  it  occurs. 

A  team  of  about  a  dozen  students  assists  reseaichers  on  site  while  tens  of  thousands  of 
remote  students  watch  live  video  streams  via  satellite  downlink.  A  small  number  of 
these  remote  students  are  also  able  to  teleoperate  the  ROV  via  the  .satellite  link. 

Moiulis  prior  to  each  annual  expedition,  teachers  ai’e  given  a  comprehensive 
multidisciplinary  instructional  guide  which  helps  integrate  subjects  such  as 
oceanography,  physics,  ai’chaeology,  hi, story,  biology  etc.  into  the  regular  school 
curricula.  Students  are  thus  provided  live  real  world  examples  to  motivate  and 
invigorate  their  studies. 

Scientists  also  remotely  participate  in  these  missions.  Scientific  objectives 
are  not  diluted  but  rather  extended  to  include  students  in  the  conduct  of  significant 
actual  research.  Live  real-time  multicast  dissemination  of  JASON  vehicle  telemeU'y 
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I'iglire  2.19.  Jaxoii.  ROV  mission  playbaok  Irom  JASON  Project  94  operating  in 
an  immersive  CAVli  environment  at  SIGGRAPH  94  (Feldman  94). 

and  imagery  over  the  Internet  was  one  of  the  first  widespread  scientific  collaborations 
that  employed  the  MBoiie.  Remote  u.sers  have  been  able  to  download  visualization 
software  to  observe  the  progress  of  each  mi.ssion.  Visual  results  aa’c  documented  in 
(Stewart  92)  (Papi^  '■)?>)  (Ro.senblum  93),  including  rendering  of  results  using  a  walk-in 
immersive  display  room  called  the  CAVE  Automatic  Virtual  Environment  (CAVE) 
(Feldman  94)  (Cruz-Neira  93).  Extension  of  the.se  results  using  a  comprehensive 
underwater  virtual  world  has  the  potential  to  further  support  distance  learning  and 
scientific  research  objectives.  The  involvement  of  motivated  and  inquisitive  students 
can  doubtless  increa.se  the  realism  and  effectiveness  of  an  underwater  virtual  world. 


2.  Acoustic  Oceanographic  Sampling  Network  (AOSN) 

A  cunvci'gciicc  of  developing  technologies  is  enabling  ambitious  new 
approaches  to  oceanography,  Autonomous  Oceanographic  Sampling  Networks 


Figure  2.20.  Autonomous  Oceanographic  Sampling  Network  (AOSN) 

environmental  mission  profile.  Other  planned  mission  profiles 
include  marine  operations,  mineral  resourecs  and  fisheries 
(Fricke  94)  (Curtin  94), 

(AOSN)  are  an  ambitious  plan  for  laige-.seale  loiig-durulion  synoptic  data  sampling 
using  inultiple  networked  autonomous  vehicles  and  .sen.sors  (Curtin  93).  Untethered 
network  connections  for  AUVs  and  underwater  .sensors  are  via  acoustic  modems  to 
network  nodes  which  relay  data  to  shore  over  radio  frequency  (RF)  links 
(Calipovic  93),  Numerous  competing  ticsign  tradeoffs  must  be  considered.  AIJV 
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propulsion  endurance  and  communications  efficiency  must  meet  energy  expense  per 
sui’vey  urea  criteria.  The  limited  bandwidth  and  noisy  acoustic  channel  of  the  water 
column  must  be  effectively  and  reliably  exploited.  The  physics  of  underwater 
transmission  are  far  different  than  RF  transmission,  so  packet  network  protocol  design 
is  not  easily  adapted.  Currently  it  is  not  clear  that  multiple  vehicles  and  sensors  will 
effectively  interconnect  with  the  Internet.  Numerous  cost-effectiveness  issues  must  be 
addressed  simultaneously.  Nevertheless  it  is  clear  that  such  an  approach  holds  the 
promi.se  of  revolutionizing  oceanographic  sampling  and  ocean  exploration. 
Interconnecting  large  numbers  of  information  entities  and  diverse  data  products  in  a 
comprehensible  fashion  is  an  excellent  application  for  implementation  in  an 
Internet-wide  underwater  virtual  world. 

3.  MBARI-NASA  Aiiies-Fustgraduatc  School-Stanford  Aerospace 

Robotics  Lab  (MAPS)  Project 

Four  research  institutions  in  the  Monterey  Bay  region  have  begun  a 
cooperative  collaboration  to  design  and  build  a  next-generation  AUV.  Propo.sed 
rapid-respun.se  science  missions  for  this  AUV  call  for  deep  depth  capability,  single 
work  day  oi)eraiing  endurance  between  recharging,  moderate  cost  and  interchangeable 
mission-specific  sensor  suites.  Use  of  an  underwater  vu’tual  world  is  likely  to  reduce 
impediments  to  regional  research  collaboration,  improve  access  to  scientific  data 
measurements,  maximize  utilization  of  shared  re.sources  and  enhance  a  common 
understanding  of  vehicle  challenges. 

4.  Live  Wor  dde  Uislributinn  of  Events 

Collaboration,  distance  learning,  human  interaction  and  communication  ol 
ideas  do  not  magically  happen  when  a  computer  is  connected  to  the  Internet.  We  have 
found  that  people  issues  and  technical  issues  are  equally  important  when  building  large 
open  networked  virtual  workspaces.  To  improve  our  understanding  of  these  issues  and 
increase  the  accessibility  of  those  worlds,  we  have  performed  an  ambitious  series  of 
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regional  and  world-wide  multicast  sessions  using  the  MBone  (Brutzman  94a,  94b,  94i;, 
d4d,  94t)  (Macedonia  y5b)  (Gambrino  94). 

Ref^ardless  of  whether  participants  are  scientists,  naval  officers,  school 
children  or  interested  hystanders,  it  is  always  the  same  real  world  that  we  are  trying 
to  recreate  virtually.  Ongoing  efforts  to  further  develop  the  underwater  virtual  world 
will  continue  to  narrowcast  computer  graphics,  video,  audio,  hypermedia  and 
DlS-compatiblc  AD  Vs  with  anyone  interested  in  participating.  These  events  will 
continue  to  extend  and  .strengthen  the  empirical  ba.sis  underlying  this  work. 

5.  Monterey  Buy  Kegiunui  Education  and  the  Initiative  fur  Information 
Infrastructure  and  Linkage  Applications  (ELA) 

A  regional  network  is  being  planned  and  built  which  will  connect 
researchers,  educators  and  students  throughout  the  ti'icounty  Monterey  Bay  region  via 
interactive  multimedia,  audio  and  video  (Brutzman  94f).  Named  the  Initiative  for 
Information  Infrastructure  and  Linkage  Applications  (I’LA),  this  group  project  is  an 
exciting  broad-ba.sed  collaboration  which  teams  educators,  scientists,  business  and 
government.  We  hope  to  fundamentally  change  local  schools  by  connecting  education 
with  active  ocean-related  research  at  the  individual  classroom  level.  Our  educational 
network  design  approach  follows  the  Internet  model  (Gargano  94).  I’LA  will  give 
individuals  at  51  different  schools  and  reseai’ch  institutions  interactive  access  to  any 
type  of  live  or  archived  media  using  a  variety  of  bandwidth  rates.  Student  ages  range 
from  kindergarten  to  postgraduate.  I’LA  exemplars  for  education  include  daily  science 
missions  using  the  Monterey  Bay  Aquarium  Re.search  In.stitute  (MBARI)  Ventana 
ROV,  Monterey  Bay  Aquarium  (MBA)  exhibits,  and  San  Jose  Technical  Museum  for 
Innovation  programs.  A  similar  regional  effort  which  uses  underwater  vehicle 
technology  as  a  focus  to  enhance  science  education  is  described  in  (Babb  92-93). 
Helping  to  build  a  regional  information  infrastructure  with  strong  ties  to  education  has 
benefited  design  of  the  network  architecture  presented  in  this  dissertation.  CurTent 
work  on  the  underwater  virtual  world  includes  adapting  the  software  to  be  suitable  as 
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Figure  2.  ' ,  Initiative  for  Information  Infrastructure  and  Linkage  Applications 
(FlA)  high  speed  communications  links.  Fifty  one  schools  and 
research  institutions  aie  being  connected. 
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an  education  application,  which  will  further  encourage  extension  of  distributed  virtual 
worlds  as  mechanisms  for  human  interaction  and  information  correlation. 

H.  SUMMARY  AND  CONCLUSIONS 

This  section  presented  work  related  to  the  design  and  construction  of  an 
underwater  virtual  world  for  an  AUV.  Overview  summaries  were  provided  for 
underwater  robotics,  robotics  and  simulation,  underwater  vehicle  dynamics,  networked 
communications  for  vu'tual  worlds,  sonar  modeling  and  visualization,  and  ongoing  and 
future  projects. 

Virtual  reality  as  exemplified  by  immersive  human-computer  interface  devices  is 
a  much  larger  albeit  related  field  which  is  outside  the  scope  of  this  work.  Key  surveys 
and  bibliographies  of  virtual  reality  concepts,  systems  and  trends  appear  in 
(Durlach  94)  (U.S.  Congre.ss  94)  (Pantelidis  94)  (Emerson  94). 

A  number  of  scientific  disciplines  and  new  technological  capabilities  are 
becoming  mutually  compatible  thanks  to  the  multiplying  effects  of  network 
connectivity.  Presentation  of  these  diverse  fields  under  the  unifying  perspective  of 
designing  AUVs  and  virtual  worlds  shows  that  many  new  possibilities  are  becoming 
feasible,  lire  review  presented  in  this  chapter  .shows  that  creation  of  a  comprehensive 
networked  virtual  world  for  an  autonomous  robot  has  not  been  previously  proposed  or 
attempted.  Following  chapters  will  specifically  show  how  numerous  competing 
research  objectives  can  be  resolved  and  implemented  to  produce  an  underwater  virtual 
w  orld  for  an  autonomous  underwater  vehicle. 
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HI.  PROBLKM  STATEMENT  AND  SOLUTION  OVERVIEW 


A.  PROBLEM  STATEMENT 

A  critical  bottleneck  exists  in  Autonomous  Underwater  Vehicle  (AUV)  design 
and  development.  It  is  tremendously  difficult  to  observe,  communicate  with  and  test 
underwater  robots,  because  they  operate  in  ■  remote  and  hazardous  environment  where 
physical  dynamics  and  sensing  modalities  are  counterintuitive. 

K.  PROPOSED  SOLUTION 

An  underwater  virtual  world  can  comprehensively  model  all  necessary  functional 
characteristics  of  the  real  world  in  real  time.  This  virtual  world  is  designed  from  the 
perspective  of  the  robot  controller,  enabling  reali.stic  AUV  evaluation  and  te, sting  in  the 
laboratory.  Three-dimensional  real-tinte  graphics  are  our  window  into  the  virtual 
world.  A  networked  architecture  enables  multiple  world  components  to  operate 
collectively  in  real  time,  and  also  permits  world-wide  observation  and  collaboration 
with  other  .scientists  interesu  >1  in  the  robot  and  virtual  world. 

C.  AUV  DEVELOPMENT  DIFFICULTIES 

The  primary  difficulty  facing  AUV  developers  is  a  challenging  physical 
environment:  an  operating  AUV  is  inaccessible,  remote,  and  unattended.  It  is 
subjected  to  extremes  of  pressure,  temperature,  corrosion.  Communications  are 
intermittent  or  nonexi.stent.  Sonar  .sensing  is  physically  slower  and  very  much 
different  from  vision.  Vehicle  deployment,  operation  and  recovery  are 
time-C'  1  Sliming  and  expensive.  Vehicle  physical  dynamic  control  is  very  challenging. 
I’hei  .  .\x  spatial  degrees  of  iTeedom  (three  dimensions  each  tor  position  and 
rotation),  not  all  physical  control  issues  are  .solved,  and  there  may  be  an  unpredictable 
influence  by  ocean  currents.  Propulsion  is  costly,  slow  and  limited.  A  typical  vehicle 
only  has  a  few  hours  endurance. 
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There  is  clear  empirical  evidence  of  a  severe  bottleneck  in  underwater  robotics. 
There  are  thousands  of  indoor  and  outdoor  land-ba.sed  mobile  robots,  many  hundreds 
of  airborne  and  .space-ba.sed  autonomous  robots,  and  many  hundreds  of  underwater 
remotely  operated  vehicles  (ROVs).  In  contrast  there  are  perhaps  a  dozen  working 
AL'Vs  in  existence,  each  with  limited  functionality.  A  harsh  working  environment  and 
susceptibility  to  physical  failure  are  among  the  major  reasons  for  this  scarcity.  AUV 
failure  in  the  ocean  is  unacceptable  for  seve  al  reasons:  any  failure  may  become 
catastrophic,  recovery  may  be  difficult  or  pointless,  and  replacement  costs  in  time  and 
money  are  prohibitive.  We  can  conclude  the  following  about  AUV  design:  reliability, 
stability  and  autonomy  are  paramount,  AUV  constraints  are  often  worst-case  for  any 
type  of  robot  due  to  challenges  inherent  in  the  underwater  environment,  and  many 
theoretical  and  engineering  probleiTiS  remain  open. 

1).  WHY  AN  UNDERWATER  VIRTUAL  WORLD? 

The  broad  requirements  of  underwater  robot  design  provide  a  strong  argument 
against  piecemeal  design  verification.  Individual  component  simulations  are  not 
adequate  to  develop  effective  intelligent  systems  or  evaluate  overall  robot 
performance.  A  preci.se  definition  of  a  virtual  world  follows  to  eliminate  any  possible 
ambiguity  in  this  term. 

Virtual  world  system. .characteristics  are  seeing  and  interacting  with  distant, 
expensive,  hazai'dous,  or  non-existent  3D  envkonments.  The  technology  for 
'seeing''  is  real-time,  interacti\“  3D  computer  graphics  and  the  technology  for 
"interacting"  is  evolving  and  .aried.  (Zyda  92b) 

An  underwater  virtual  world  for  an  autonomous  underwater  vehicle  is  intended 
to  provide  complete  functionality  of  a  submerged  environment  in  the  laboratory.  A 
virtual  world  c:n  provide  adequate  simulation  scope  and  interaction  capability  to 
overcome  the  inherent  design  handicaps  imposed  when  building  a  remote  robot  to 
operate  in  a  hazardous  environment.  Construction  of  a  virtual  world  for  robot 
development  and  evaluation  is  hereby  proposed  as  a  necessary  prerequisite  for 


4X 


successful  design  of  a  complex  robot  which  operates  in  a  hazardous  environment,  such 
as  an  AL'V. 

A  virtual  world  used  to  recreate  every  aspect  of  the  environment  external  to  the 
robot  must  also  include  robot  sensors  and  analog  devices  (such  as  thrusters  and 
rudders)  which  are  impossible  to  realistically  operate  in  a  laboratory.  Interactions 
between  software  proces.ses,  vehicle  hardware  and  the  real  world  must  all  be 
comprehensively  modeled  and  mutually  consistent.  Robot  physical  behavior  and 
sensor  interactions  must  be  modeled  and  simulated  exactly. '  The  robot  controller  itself 
is  directly  plugged  into  the  virtual  world  using  normal  sensor  and  actuator  connections, 
either  physically  or  logically.  The  difference  between  operation  in  a  virtual  world  or 
an  actual  environment  must  be  transparent  to  robot  software  in  order  to  be  effective. 

The  current  underwater  robot  development  paradigm  is  inadequate  and  costly. 
Piecemeal  design  verification  and  individual  component  simulations  are  not  adequate 
to  develop  and  evaluate  sophisticated  artificial  intelligence  (Al)-based  robot  systems. 
Virtual  world  systems  provide  a  capability  for  robots  and  people  to  see  and  interact 
within  synthetic  environments.  The  research  goal  of  this  dissertation  is  to  provide 
complete  functionality  of  the  target  environment  in  tfie  lab,  providing  adequate 
simulation  scope  and  interaction  capability  to  overcome  the  inherent  design  handicaps 
of  classical  simulation  approaches.  AUV  underwater  virtual  worlds  may  break  the 
AUV  development  bottleneck. 

E.  AUV  UNDERWATER  VIRTUAL  WORLD  CHARACTERISTICS 

The  underwater  virtual  world  must  recreate  the  complete  environment  external  to 
the  robot.  Robot  phy,sical  dynamics  behavior  mu.st  be  correctly  reproduced,  since 
underwater  vehicles  are  prone  to  nonlinear  dynamic  instabilities  and  unpredicted 
physical  responses  may  result  in  vehicle  loss.  Robot  sensors  and  analog  devices  must 
be  also  modeled  accurately.  To  minimize  .sources  of  simulation  error,  an  exact  copy 
of  robot  hardware  and  softw;ue  is  plugged  into  the  virtual  world  using  physical  or 
logical  sensor  and  actuator  connections.  The  difference  between  operation  in  a  virtual 


world  or  an  actual  environment  must  be  transparent  to  the  robot  software.  Finally, 
successful  implementation  of  a  virtual  world  can  be  quantitatively  validated  by 
identical  robot  performance  in  each  domain.  This  is  a  type  of  Turing  test  from  the 
robot’s  perspective:  if  robot  performance  is  identical  in  each  domain,  then  the  virtual 
world  is  functionally  equivalent  to  the  real  world. 

Numerous  component  models  make  up  the  vii'tual  world.  Principal  among  them 
are  a  six  degree-of-freedom  hydrodynamics  model  and  geometric  sonar  model.  All 
models  must  interact  with  the  robot  in  real  time.  Additionally,  to  be  fully  effective, 
the  virtual  world  needs  to  provide  connectivity  to  viewers  at  any  location  for  remote 
observation  and  participation.  A  cmefully  constructed  set  of  network  connections 
enables  all  of  these  goals  to  be  met  simultaneously. 

The  overall  structure  of  the  AU'V  underwater  virtual  world  software  architecture 
is  illustrated  in  Figure  3.1.  This  ai'chitectural  .structure  diagram  is  very  broad  and  is 
intended  to  show  how  many  component  models  can  work  together.  Most  virtual  world 
components  have  been  implemented  in  this  dissertation,  demonstrating  the  soundness, 
validity  and  scalability  of  the  resulting  virtual  world. 

V.  NETWORKING 

Distribution  of  underwater  virtual  world  components  enables  scalability  and 
real-time  response.  A  distributed  approach  also  minimizes  dependence  on  unique  (or 
hard-to-replace)  hardware  and  softwai'e.  A  standai'd  point-to-point  socket  connects  the 
robot  and  the  virtual  world  allowing  rapid  and  direct  two-way  interaction.  The  IEEE 
Distributed  Interactive  Simulation  (DIS)  protocol  (NPS  implementation  version  2.U.3) 
is  also  used  for  compatible  interaction  with  other  virtual  worlds  and  users  listening  on 
the  Internet  (IEEE  93)  (Ze.switz  93). 

This  project  is  an  excellent  application  to  take  advantage  of  a  high-bandwidth 
Internet,  further  extending  the  capabilities  of  multiple  researchers.  The  network 
approach  allows  many  individuals  dynamic  remote  access,  which  is  demonstrated  by 
Multicast  Backbone  (MBone)  transmission  of  video,  graphics,  sound  and  DIS  reports 
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Figure  3.1.  NPS  AUV  underwater  virtual  world  softwai'e  architecture. 


for  collaboration  with  other  participants  outside  the  site  where  the  robot  and  virtual 
world  are  operating.  Providing  hypermedia  access  via  publicly  available 
World-Wide  Web  (WWW)  network  browsers  such  as  Mosaic  makes  a  complete 
variety  of  pertinent  archived  information  available  to  anyone.  Retrievable  information 
resources  include  images,  papers,  datasets,  softwai'e,  sound  clips,  test,  speech,  source 
code.  e.xecLitable  programs,  live  or  ai'chived  video,  and  any  other  computer-storable 
media.  Together  MBone  and  the  World-Wide  Web  provide  the  infrastructure  of  the 
information  superhighway,  letting  anyone  li.sten  in  and  watch  your  work.  Addition  of 
multicast  networked  DIS  packets  and  publicly  available  software  lets  people  observe 
an  identical  interactive  virtual  world  from  any  location  with  minimum  burden  on  the 
global  Internet.  Remote  interaction  by  numerous  players  within  the  virtual  world  of 
robot  and  environment  becomes  feasible  and  even  convenient. 

(i.  IMPORTANCE  01' SENSORS 

Design  of  autonomous  underwater  robots  is  particularly  difficult  due  to  the 
physical  and  sensing  challenges  of  tlie  undei'water  environment.  Robot  performance  is 
often  very  tightly  coupled  to  sensor  accuracy  and  interpretation.  Emergent  behavior 
from  interaction  between  robot  processes  and  the  environment  can  only  be  determined 
through  experimentation.  Having  valid  sonar'  and  terrain  models  is  very  valuable  for 
robot  design  and  testing,  since  sensor  interactions  can  be  repeated  indefinitely.  Many 
new  research  projects  become  possible.  Machine  learning  based  on  massive  repetitive 
training  is  feasible,  such  as  the  design  and  implementation  of  trainable  genetic 
algorithms  or  neural  networks.  Potentially  fatal  scenarios  can  be  attempted  repeatedly 
until  success  is  reliably  achieved,  without  risk  to  robot,  human  or  envu'onment. 

H.  SONAR  VISUALIZATION 

Visualization  of  robot  sensor  interactions  within  a  vh'tual  world  permits 
sophisticated  analy.ses  of  robot  performance  that  are  otherwise  unavailable.  Sonar 
visualization  permits  researchers  to  accurately  "look"  over  the  robot’s  shoulder  or  even 
"see"  through  the  robot’s  eyes  to  intuitively  understand  sensor-envii'onment 
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interactions.  Similar  in-depth  analysis  is  not  po.ssible  using  aaditional  test  methods 
such  as  individual  software  module  evaluation,  direct  robot  ob.servation  or  post-mission 
scenario  reconstruction.  In  particular,  the  overwhelming  size  and  information  content 
of  occan-rclated  and  robot-related  data.sets  means  that  visualization  is  es.sential  to 
c.stract  meaning  from  numerous  simultaneous  quantitative  relationships.  Visualization 
of  the  robot  in  its  surroundings  greatly  improves  human  understanding. 

An  initial  geometric  sonar  model  implementation  demonstrates  how  larger-scale 
sonar  and  terrain  models  can  fit  into  die  underwater  virtual  world  ai'chitecture.  More 
detailed  visualizations  of  environmental  datasets  and  a  general  sonar  model  have  been 
implemented  offline.  They  are  included  to  show  how  additional  sonar  visualization 
capabilities  can  extend  even  further  the  functionality  of  the  implemented  underwater 
virtual  world.  Future  work  in  sonar  and  terrain  includes  scaling  up  these  models  for 
interaction  using  world  spaces  of  arbitrary  sizes. 

I.  PARADKJM  SHIFI  S:  CONTENT,  CONTEXT,  AND  WORLD  IN  THE 
LOOP 

Within  two  lifetimes  we  have  seen  .several  paradigm  shifts  in  the  ways  that 
people  record  and  exchange  information.  Handwriting  gave  way  to  typing,  and  then 
typing  to  word  processing.  It  was  only  a  short  while  afterwards  tliat  preparing  text 
with  graphic  images  was  easily  accessible,  enabling  individuals  to  peiform  desktop 
publishing.  Cuirently  people  can  use  3D  real-time  interactive  graphics  simulations  and 
dynamic  "documents"  with  multimedia  hooks  to  record  and  communicate  information. 
Furthermore  such  documents  can  be  directly  distributed  on  demand  to  anyone 
connected  to  the  Internet.  In  this  project  we  .see  a  further  paradigm  sh'ft  becoming 
possible.  The  long-term  potential  of  virtual  worlds  is  to  serve  as  an  archive  and 
interaction  medium,  combining  massive  and  di.ssimilar  data  sets  and  data  streams  of 
every  conceivable  type.  Virtual  worlds  will  then  enable  comprehensive  and  consistent 
interaction  by  humans,  robots  and  software  agents  within  those  massive  data  sets,  data 
streams  and  models  that  recreate  reality.  Virtual  worlds  can  provide  meaningful 
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context  to  the  mountains  of  content  which  currently  exist  in  isolation  without  roads, 
links  or  order. 

As  networked  virtual  worlds  mature  they  will  become  more  robust,  efficient  and 
portable.  Going  past  the  logical  conclusion  of  "hardware  in  the  loop"  u.se  of  robots 
within  a  virtual  world,  as  is  pre.sented  in  this  dissertation,  eventually  virtual  world 
models  will  be  embeddable  back  into  the  robots.  Having  a  "world  in  the  loop"  as  an 
embeddable  component  in  this  manner  will  extend  the  capabilities  of  robots  to  sense, 
interpret  and  interact  with  the  real  world  around  them.  The  fidelity  and  scope  of 
virtual  world  models  and  representations  will  improve  steadily  as  robots  and  humans 
operate  interchangeably  in  virtual  worlds  and  the  real  world. 
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IV.  NFS  AUTONOMOUS  UNDERWATER  VEHICLE 


A.  INTRODUCTION 

Detailed  knowledge  regarding  robot  requirements  is  a  necessary  prerequisite  for 
implementing  robot  operation  in  a  virtual  world.  This  chapter  describes  key 
considerations  in  underwater  robotics  hardwai'e  and  software,  particularly  as 
instantiated  in  the  NFS  AUV.  Familiarity  with  the  Chapter  11  review  of  related 
robotics  projects  is  recommended.  An  overview  of  generic  AUV  hardware  and 
software  is  followed  by  NFS  AUV  hardwaj;e  specifications  and  software- 
characteristics.  Additional  overview  descriptions  of  the  NFS  AUV  and  related 
research  appear  in  (Brutzman,  Compton  91)  and  (Healey  92a).  Due  to  the  large 
variety  of  critical  tasks  an  autonomous  underwater  robot  must  perform,  a  robust 
multilevel  software  architecture  is  essential,  'fhe  software  architecture  used  by  the 
NFS  AUV  is  the  Rational  Behavior  Model  (RBM).  The  three  levels  of  RBM  are 
described  with  emphasis  on  the  real-time  chai'acteristics  of  each  level.  Details  are  also 
provided  regarding  vehicle  software  developed  in  this  work.  Specific  contributions  of 
this  dis.sertation  include  extending  the  RBM  execution  level  and  improving 
implemented  RBM  interprocess  communication  (IFC). 

B.  UNDERWATER  ROBOTICS 

Although  there  are  far  fewer  robots  designed  to  operate  underwater  than  in  other 
environments,  there  is  much  diversity  in  the  hai'dware  and  software  of  those  robots 
that  e.Kist.  Underwater  robot  hardware  is  mostly  concerned  with  watertight  integrity, 
maneuvering  and  sensing.  Underwater  robot  softwaie  is  usually  preoccupied  with 
real-time  hardware  control.  Implemented  higher-level  funetions  are  rarely  as 
sophisticated  or  capable  as  desired.  Although  manipulators  and  intervention  tools  are 
common  on  remotely-operated  vehicles  (ROVs),  they  remain  a  rarity  on  autonomous 
robots  becau.se  fundamental  problems  of  ship  control,  navigation  and  classification  of 
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detected  objects  are  not  well  solved.  Recent  overviews  of  prominent  AUVs  and 
related  technical  problems  are  (Fricke  94)  (Zorpette  94).  The  best  way  to  understand 
the  capabilities  and  weaknesses  of  the.se  vehicles  is  to  watch  them  in  operation.  High 
quality  videotape  footage  and  written  summaries  of  state-of-the-art  underwater  robots 
appear  in  recent  video  conference  proceedings  (Brutzman  93a)  (Brutzman  94a), 

1.  Underwater  Vehicle  Hardware 

Unfortunately  the  cost  in  time  and  money  of  assembling  an  AUV  is  high 
and  currently  beyond  the  reach  of  most  academic  institutions.  Nevertheless  most 
hardware  components  are  commercially  available,  particularly  since  the  remote 
operated  vehicle  (,ROV)  industry  is  well  established  and  thousands  of  ROVs  have  been 
deployed.  Institutions  considering  building  an  AUV  ai'e  advised  to  stai't  by  looking  at 
existing  ROVs  and  related  components  that  can  be  adapted  for  autonomous  operation. 

Pressure  hulls  for  AUVs  typically  fall  into  two  categories:  streamlined  and 
open  frame.  Streamlined  hulls  me  useful  for  operating  at  high  speed,  or  minimizing 
drag  so  that  propulsion  endurance  is  maximized.  Open  frame  hulls  typically  consist  of 
a  framework  of  nining  open  to  the  ocean,  witli  all  components  bolted  onto  the  frame 
wherever  appropiiaie.  At  low  operating  speeds  drag  is  not  a  significant  handicap,  and 
the  open  frame  simplifies  placement  and  adjustment  of  hardware  devices. 

Power  supplies  and  propulsion  endurance  are  a  significant  weak  point  in 
current  AUVs.  Most  vehicles  are  powered  by  lead-acid  or  silver-zinc  batteries  with 
usable  capacity  ranging  from  several  hours  to  about  a  day.  Hydrogen  gas  generation 
during  battery  charging  or  discharge  is  a  serious  personnel  and  equipment  hazard. 
Research  and  development  work  in  improving  power  density  has  focused  for  a  number 
of  years  on  alternative  battery  electrochemistries,  closed-cycle  (self-oxidizing)  engines 
and  aluminum  hydroxide  fuel  cells,  but  dramatic  improvements  in  cost  or  capability 
are  not  soon  expected.  Eventually  the  active  research  and  development  of  improved 
battery  technology  for  electric  cars  and  laptop  computers  may  provide  useful  power 
supply  alternatives. 
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Sensors  are  one  of  several  key  technologies  that  distinguish  underwater 
rnbois  lioni  ground,  air  and  space-based  robots.  Since  the  oceans  ar'e  generally 
opaque  lo  visible  light  at  moderate-to-long  ranges,  vision-based  video  systems  are 
unreliable  in  turbid  water  and  are  ordinarily  of  use  only  at  short  distances.  Vision 
systems  usually  require  inten.se  light  sources  which  further  deplete  precious  energy 
reserves.  In  comparison  to  underwater  computer  vision,  sonar  (acoustic  detection)  has 
lung  been  a  preferred  sensing  method  due  to  the  very  long  propagation  ranges  of 
sound  waves  underwater,  However,  sound  waves  can  be  bent  by  variations  in  depth, 
temperature  and  salinity.  A  variety  of  problems  including  ambient  noi,se,  multipath 
arrival,  fading,  shadow  layers,  masking  and  other  effects  can  make  sonar  u,se  difficult. 
Since  active  sonar  typically  provides  good  range  values  with  approximate  bearing 
values,  algorithms  for  sonar  recognition  are  much  different  than  vision  algorithms. 
Blue-green  lasers  are  relatively  new  underwater  sensors  that  ai'e  useful  since  they  can 
provide  accurate  range  and  accurate  bearing  data  at  short-to-moderate  ranges  with  low 
power  consumption.  Other  hardware  sensors  of  interest  to  AUVs  include  pressure 
instruments,  flow  detectors,  inertial  navigation  acceleration  and  angular  rate  sensors, 
and  fast  Global  Positioning  System  (GPS)  receivers.  New  and  vailed  .sensors  ai'e 
being  developed  for  oceanographic  survey  measurements  and  trace  chemical  detection 
(Bales  94a.  94b). 

Communications  with  underwater  vehicles  ai'e  notoriously  difficult, 

Tethers  can  provide  high  bandwidth  and  even  a  power  supply,  but  remain  subject  to 
entanglement  and  breakage  with  the  subsequent  possibility  of  vehicle  loss.  Tethers 
typically  require  tether  management  systems  which  can  be  very  costly  in  their  own 
right,  'fethers  also  incfuce  undesirable  and  vai'ying  drag  forces  on  the  underwater 
vehicle.  Acou,stic  modems  are  a  useful  innovation  that  can  provide  communications 
links,  but  are  very  susceptible  to  channel  noise  and  channel  lo.ss  problems,  A  serious 
limitation  in  current  acoustic  modems  is  incompatibility  with  the  Internet  Protocol 
(IP),  and  further  network  research  efforts  are  necessary  to  incorporate  forward  error 
correction  (FEC)  and  transport  protocol  functionality  for  reliable  internetworking  of 
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underwater  deviees.  Acoustic  lung-baseline  and  short-baseline  navigation  can  be  used 
to  determine  underwater  vehicle  location  by  measuring  time  of  flight  of  pings  between 
beacons  at  fixed  locations  and  a  transponder  located  on  the  vehicle.  Beacon  pings  can 
be  further  encoded  to  pass  positional  information  back  to  the  vehicle.  Unfortunately, 
the  primary  limitation  of  navigation  in  an  acoustic  field  is  that  beacons  must  be 
deployed  beforehand  in  known  locations  around  the  area  of  interest. 

2.  Robot  Software  Architectures 

Designing  an  AUV  is  complex.  Many  capabilities  ai'e  required  for  an 
underwater  mobile  robot  to  act  capably  and  independently.  Stable  physical  control, 
motion  control,  sensing,  motion  planning,  mission  planning,  replanning  and  failure 
recovery  are  example  software  components  that  must  be  solved  individually  for 
tractability.  The  diversity  and  dissimilarity  of  these  many  component  subproblems 
precludes  use  of  a  single  monolithic  artificial  intelligence  (Al)  paradigm. 

Distributed  AI  usually  addresses  specifications  and  protocols  between 
similar  autonomous  agents  working  cooperatively  on  global  problems.  Hybrid 
reasoning  often  refers  to  novel  combinations  of  two  or  three  techniques  to  improve 
overall  performance  when  solving  a  single  problem  type.  Neither  definition  appears 
suitable  for  general  robot  control.  Multiple  dissimilar-  Al  proces.ses  must  interact  in  an 
intelligent  manner  to  achieve  the  robust  capabilities  and  multiple  behaviors  needed  by 
a  mobile  robot  (Elfes  86).  A  variety  of  robot  architectures  have  been  proposed  and 
developed  to  provide  the  control  framework  under  which  multiple  Al  processes  can 
interact.  A  brief  di.scussion  of  current  robot  architectures  is  therefore  useful  to  clarify 
the  scope  of  robot  design  i.ssues. 

Robot  architectures  can  be  classified  over  a  spectrum  that  ranges  from 
hierarchical  to  reactive  (Byrnes  93).  Hierarchical  architectures  can  be  characterized  as 
being  deliberative,  symbolic,  structured,  "top  down,"  goal-driven,  and  having  explicit 
focus  of  attention.  They  are  often  implemented  using  backward  inferencing. 
Hierarchical  approaches  typically  contain  world  models  and  use  planning  and  seai'ch 
techniques  to  achieve  strictly  defined  goals.  Hierarchical  ai'chitectures  tend  to  be 


S'  lewhat  rigid,  unrespoii.sive  in  unpredicted  situations  and  computation-intensive. 
Nesertlicless  they  remain  capable  of  highly  sophisticated  performance. 

Reactive  architectures  are  subsuinptive,  "bottom  up,"  sensor-driven,  layered 
and  may  often  be  characterized  by  forward  inferencing.  Reactive  architectures  attempt 
to  combine  robust  subsuming  behaviors  while  avoiding  dynamic  planning  and  world 
models.  Reactive  architectures  appear  to  behave  somewhat  randomly  and  achieve 
success  without  massive  computations  by  using  well-considered  behaviors  that  tend  to 
lead  to  task  completion  (Brooks  86,  90).  Scaling  up  to  complex  missions  is  difficult. 
Stability  and  deterministic  performance  is  elu.sive. 

It  is  interesting  to  note  that  numerous  robot  ai’chitecture  researchers  have 
recently  propo.sed  hybrid  control  architectures  (Kwak  92)  (Bonasso  92) 

(Bellingham  90)  (Payton  91)  (Spector  91).  A  common  theme  in  these  proposals  is 
integrating  the  long-term  deliberation,  planning  and  state  information  found  in 
hierarchical  approaches  with  the  quick  reaction  and  adaptability  of  subsumptive 
behaviors.  Individual  weaknesses  of  hierarchical  and  reactive  architectures  appear  to 
be  well-balanced  by  their  respective  strengths. 

Physical  stability  and  reliability  de.serve  repeated  mention  in  the  context  of 
multiple  interacting  proces.ses.  Control  sy.stem  considerations  are  often  overlooked 
under  the  gui.se  of  simplifying  assumptions  that  hide  important  real  world  restrictions 
and  pitfalls.  Robot  survivability  dictates  that  physical  and  logical  behavior  must 
always  converge  to  a  stable  yet  adaptive  set  of  states.  Divergence,  deadlock,  infinite 
loops  and  unstable  dynamic  behavior  must  be  detectable  and  preventable.  Hard 
real-time  operating  constraints  on  sensing,  processing,  action  and  reaction  must  be 
similarly  resolved.  Rol^otics  research  in  other  envhonments  are  expected  to  be 
pertinent  and  useful;  for  example,  physical  stability  prerequisites  become  similarly 
important  for  ground  robots  as  they  progress  from  sti'uctured  to  unrestricted 
environments.  Finally  it  is  worth  reiterating  that  an  underwater  virtual  world  is 
proposed  as  the  best  way  to  enable  repeated  testing  of  underwater  vehicle  control, 
stability  and  reliability. 
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C.  NFS  AUV  HARDWARE 

The  NFS  AUV  has  four  paired  plane  surfaces  (eight  fins  total)  and  bidirectional 
twin  propellers.  The  hull  is  made  of  pressed  and  welded  aluminum.  The  vehicle  is 
ballasted  to  be  neunally  buoyant  at  3X7  lb.  Design  depth  is  2U  ft  (6.1  m).  A  pair  of 
sealed  lead-acid  gel  batteries  supports  vehicle  endurance  of  90-120  minutes  at  speeds 
up  to  2  ft/.sec  (0.61  nVsec). 

A  Free-flooded  fiberglass  sonar  dome  supports  two  forward-looking  sonar 
transducers,  a  downward-looking  sonar  altimeter,  a  water  speed  flow  meter  and  a 
depth  pressure  cell.  Five  rotational  gyros  mounted  internally  are  used  to  measure 
angles  and  rates  for  roll,  pitch  and  yaw  respectively.  Cross-body  thruster  tunnels  were 
designed  and  built  For  the  NFS  AUV.  An  inline  bidirectional  propeller  in  each 
thruster  can  provide  up  to  2  pounds  of  force  (Cody  92)  (Healey  y4b). 

Detailed  specifications  of  all  NFS  AUV  hardware  components  ai’e  presented  in 
(Torsiello  94).'  An  external  view  of  the  vehicle  is  shown  in  Figure  4.1  and  primary 
internal  component  arrangements  are  .shown  Figure  4.2.  A  detailed  schematic  of 
vehicle  internal  components  appeal's  in  Figure  4.3.  A  photograph  showing  the 
NFS  AUV  in  the  test  tank  is  provided  in  Figure  4.4. 
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Exterior  view  of  NPS  AUV,  8  plane  surfaces  and  twin  propellers. 
Length  is  8’  (2.4  m),  height  10"  (25.4  cm),  width  16.5"  (41.9  cm). 
Weight  and  buoyancy  are  each  435  lb  (197.5  kg)  when  submerged. 


igiire  4.2, 


Internal  view  of  principal  NPS  AUV  components. 

Four  cross-body  thrusters:  two  lateral  and  two  vertical. 

Two  card  cages  contain  68()30/OS'9  and  386/DOS  microproccs.sors. 
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1  Noeepieoe  (flooded) 

2  fTT-KXX) 

3  Datasonlcs 

4  Sr-725 

6  Flow  Meter 

6  Depth  Cell 

7  Coutjpol  Pin  Servo  Motor 

8  HomonUd  Thruater 

9  Servo  Amp 


10  Power/Run  Plug 

11  Serial  Port  Connector 

12  Vertical  Thmater 

13  Rate  Gyro 

14  Vertical  Gyro 
16  12  VDC  Battery 

16  ACON  Power  Supply 

17  Cain  Power  SuppUea/ 
CRVDOM  Relaya 


18  GESPAC  (Execution  Proceoeor)  08-9 

19  GESPAC  (Tactical  ProocMor)  DOS 

20  Syncbn/Digital  Converter 

21  Preaaure  Hull  (Air  durewi  to  1  pai) 

22  Inverter  (Motor  Inhibiter) 

23  Free  Directional  Gym 

24  400  Hx  Power  Supply 
26  Stem  Propolekm  Moton 


Figure  4.3.  NPS  AUV  II  internal  components  layout  (Torsiello  94). 


The  NPS  AUV  is  primarily  desijjned  for  reseaich  on  autonomous  dynamic 
control,  sensing  and  Al.  Software  control  of  the  vehicle  is  provided  at  a  high  level 
corresponding  to  strategic  planning  and  tactical  coordination,  as  well  as  at  a  low  level 
corresponding  to  hydrodynamics  control  of  plane  surfaces  and  propellers.  Sensors  are 
also  controlled  via  execution  level  microprocessor-hardware  interfaces,  although  some 
sensor  functions  (such  as  steering  individual  sonar  transducer  bearing  motors)  may  be 
optionally  commanded  by  the  supervising  tactical  level.  TRITECH  sonar  range 
resolution  varies  with  maximum  range  and  selected  range  bin  size.  Sonar 
specifications  appear  in  Table  4.1,  derived  from  (Torsiello  94). 


Table  4.1.  NPS  AUV  Sonar  Types  and  Specifications. 


Sonars  and 
pararneters 

Tritech  ST- 1000 

Tritech  ST-725 

Datasonics 

PSA-900 

Function 

Conical  scan 

Vertical  sector  scan 

Depth  sen, sing 

Beam  shape 

1  °  pencil  cone 

24°  vertical 
by  1°  wide 

10°  cone 

Frequency 

1250  KHz 

725  KHz 

210  KHz 

Maximum  range 

4..50  m 

6..  100  m 

27  m 

Range  resolution 

1..X0  cm 

4.. 80  cm 

~  1  cm 

Steering  increment 

0.9°  horizontal 
mechanical  drive 

0.9°  horizontal 
mechanical  drive 

fixed  downward 
not  steerable 

Operating  modes 

A _ 

Sector  Profile, 
Sector  Scan 

Sector  Scan 

Data  averaging 
(4  ping  window) 

10  Hz 

10  Hz 

Location  in  bow 

port  below 

port  abo  'e 

starboard  below 

Two  microproces.sors  are  available  for  u.se  aboard  the  NPS  AUV: 
a  Motorola  dX()3()  and  an  hitel  303X6.  Each  is  mounted  on  a  4"  by  6"  Eurobns  card 
manufactured  by  Gespac  Inc,  The  operating  system  for  the  6X030  is  the  OS-9 
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real-time  operating  system  by  Microware  Inc.  Support  for  the  OS-9  operating  sy.stem 
running  on  Gespac  computers  is  problematic  at  best;  a  recommended  reference  for 
OS-9  users  is  (Dayan  92).  Operating  sy.stem  for  the  3()3H6  is  Digital 
Re.search  (DR)  DOS  6.0.  chosen  for  small  kernel  size  and  the  ability  to  manually 
switch  between  tasks.  Multitasking  operating  .systems  such  as  Windows  and  OS/2 
were  earlier  considered  and  rejected  due  to  their  insistence  on  graphical  u.ser  interface 
overhead.  To  date  the  30386  has  not  been  used  for  in-water  missions.  A  variety  of 
different  processors  and  operating  systems  are  being  considered  for  future  NFS  AUV 
configurations.  Unfortunately  the  large  volume  of  intricate  legacy  code  dedicated  to 
controlling  numerous  analog-digital  controller  cards  and  devices  has  so  far  precluded 
wholesale  replacement  of  the  current  microprocessor/operating  system  combinations. 

Vehicle  designers  must  note  that  sealed  lead-acid  gel  batteries  are  still 
susceptible  to  hydrogen  gas  generation  and  venting  (Calder  94),  which  becomes  an 
e.splosive  hazard  above  5%  by  atmospheric  volume.  Reliance  on  NFS  AUV  battery 
seals  together  with  excessive  recharging,  mission  repetition  and  insufficient  venting 
resulted  in  a  submerged  hydrogen  explosion  in  early  1994.  Significant  hull  damage 
resulted  and  most  electrical  equipment  was  a  complete  loss  due  to  flooding  under 
power.  No  personnel  were  injured.  Repairs  took  most  of  the  year,  but  the  refurbished 
and  renamed  NFS  AUV  "Phoenix"  resumed  submerged  testing  in  October  1994. 

1).  NFS  AUV  SOFTWARE 

Ongoing  development  of  NFS  AUV  .software  has  continued  for  over  eight  years, 
A  great  deal  of  novel  software  research  has  been  conducted  during  this  period. 
Underwater  robot  software  ai'chitectures  are  a  pa'ticular  challenge  because  they  include 
a  great  many  of  the  hardest  problems  in  robotics  and  A I  over  short,  medium  and  long 
time  .scales.  The  principal  features  and  les.sons  learned  to  date  relating  to  NFS  AUV 
software  are  summarized  in  the  following  .sections. 
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1.  Rational  Behavior  Model  (RBM)  Software  Architecture 

The  Rational  Behavior  Model  (RBM)  is  a  trilevel  multiparadigm  software 
architecture  for  the  control  of  autonomous  vehicles  (Kwak  92)  (Byrnes  92,  93,  95). 
Strategic,  tactical  and  execution  levels  correspond  roughly  to  high-level  planning, 
intermediate  computational  processing  of  symbolic  goals,  and  direct  interaction  with 
vehicle  hardware  and  the  environment.  The  three  levels  of  RBM  correspond  to  levels 
of  software  abstraction  which  best  match  the  functionality  of  associated  tasks. 
Temporal  requirements  range  from  soft  real-time  planning  at  the  strategic  level  to  hard 
real-time  requirements  at  the  execution  level,  where  precise  control  of  vehicle  sensors 
and  propulsion  is  necessary  to  prevent  mission  failure  and  vehicle  damage. 

RBM  provides  an  overall  structure  for  the  large  variety  of  NFS  AUV 
software  components,  A  particular  advantage  of  RBM  is  that  the  three  levels  ai'e 
analogous  to  the  watchstanding  organization  of  naval  ships.  The  sti'ategic  level 
matches  long-range  planning  by  the  commanding  officer.  ITie  tactical  level 
corresponds  to  officer  of  the  deck,  navigator  and  officer  watchstanders.  The  execution 
level  corresponds  to  helmsmen,  planesmen  and  sonar  operators.  Such  analogies  ui'e 
panic ulai'ly  useful  for  naval  officers  working  on  this  project  who  know  how  to  drive 
ships,  since  it  provides  a  well-understood  partitioning  of  duties  and  a  precisely  defined 
task  lexicon. 

Fi'ogranuning  paradigms  aie  explicitly  defined  at  each  level  of  RBM  in 
Older  to  best  match  programming  languages  to  objectives.  Strategic  level  goals  are 
typically  defined  and  met  using  backwards  chaining.  T.ictical  modules  ai'e 
object-oriented  and  use  message  passing  to  communicate.  The  execution  level  is 
imperative.  Typical  languages  for  each  level  are  Prolog,  object-oriented  Classic  Ada 
and  C,  respectively.  Variations  on  the  strategic  level  have  produced  provably 
equivalent  variations  using  forward  chaining  and  backward  chaining  (Scholz  93). 
(Byrnes  93)  implemented  all  three  RBM  levels  concurrently  in  simulation,  running 
under  networked  Unix  workstations  but  not  on  the  NFS  AUV  proper.  Initial 
implementation  efforts  for  this  di.s.sertation  included  integrating  and  te.sting  a  tactical 
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level  with  an  improved  execution  level,  where  source  code  for  both  levels  compiles 
identically  and  runs  compatibly  either  on  vehicle  hardware  or  on  networked 
workstations. 

The  primary  contribution  of  this  dissertation  to  RBM  is  extensive 
development  and  implementation  of  the  execution  level  (Brutzman  94e),  as  well  as 
formal  specification  and  implementation  of  execution  level  communications 
requirements.  As  predicted  by  (Brutzman  92a,  92c),  availability  of  hydrodynamics  and 
sonar  models  for  integrated  simulation  during  robot  development  have  been  invaluable 
for  development  of  robot  control  algorithms.  Implementations  of  strategic  and  tactical 
levels  in  previous  theses  have  only  run  in  i.solation  and  have  never  been  tested 
underwater  due  to  inadequate  execution  level  functionality  (Brutzman  92a)  (Byrnes  93) 
(Compton  92)  (Ong  90)  (Scholz  93)  (Thornton  93)  (Wilkin.son  92).  Completion  of  a 
robust  execution  level  in  this  dissertation  now  permits  meaningful  integration  of 
strategic  and  tactical  RBM  levels  with  a  capable  execution  level. 

2.  Multiple  Operating  Systems  and  Multiple  Programming  Languages 

Given  the  relative  uniqueness  and  slowne.ss  of  the  NPS  AUV 
microprocessors,  operating  systems  and  interfaces,  it  is  desirable  to  be  able  to  compile, 
run  and  test  AUV  software  on  a  variety  of  platforms.  The  predominant  computing 
asset  available  to  the  NPS  AUV  research  group  is  Unix  workstations,  pai’ticulaidy 
Silicon  Graphics  Inc.  (SGI)  graphics  workstations.  Although  Unix  is  not  a  real-time 
operating  system,  it  can  be  made  to  emulate  the  functionality  of  the  real-time 
operating  system  OS-9  u.sed  for  the  execution  level,  and  the  more  common  DOS 
operating  system  used  for  the  tacti  ;al  level.  To  date  the  strategic  level  has  not  been 
implemented  in  the  vehicle  due  to  lack  of  a  workable  multitasking  environment  on  the 
tactical  S()3Sb  microprocessor.  Several  attempts  to  multitask  strategic  and  tactical 
leve's  using  the  Ada  and/or  CLIPS  languages  were  unsuccessful  (Scholz  93) 

(Thornton  93). 

The  area  of  greatest  interest  to  robotics  researcher:;  is  developing  source 
code  that  implements  propo.sed  algorithms.  Standardized  languages  tu'e  an  essential 


requirement  for  source  code  that  is  portable  across  multiple  hardwiire  platforms. 
Languages  u.sed  in  the  NFS  AUV  project  reflect  this  criteria:  Prolog,  CLIPS,  Ada, 
Classic  Ada,  C  and  C++  have  all  been  used.  Theoretically,  compilers  for  different 
architectures  will  compile  source  code  identically  on  each  platform.  In  practice, 
successful  compilation  of  a  single  version  of  source  code  by  multiple  compilers  is  a 
rarity.  Modified  compilation  control  makefiles  and  context-.sensitive  compiler 
directives  may  be  able  overcome  variant  compiler  limitations  (Brutzman  94e).  Such 
an  approach  is  essential  because  there  then  needs  to  be  only  one  single  version  of 
robot  code  that  can  compile  and  run  .succe.ssfully  in  any  appropriate  environment. 

NFS  AUV  project  expc.ience  has  repeatedly  shown  that  failure  to  insist  on 
cross-platform  compatibility  leads  to  "versionitis"  and  configuration  control  problems 
which  prevent  research  code  from  being  succe.ssfully  implemented  and  integrated  with 
previous  vehicle  software  efforts.  Such  failures  are  unacceptable. 

Given  that  source  code  is  written  in  a  standardized  language  and  compiles 
on  all  pertinent  platforms,  a  further  significant  pmblem  can  occur.  Although  the 
hybrid  language  approach  espoused  by  RBM  provides  an  excellent  match  between 
software  abstraction  and  intended  functionality,  getting  dissimilar’  languages  to 
compile,,  link  and  execute  compatibly  is  extremely  difficult.  In  every  possible 
combination  that  we  have  examined  and  tested,  implementation  of  hooks  between 
languages  and  linking  multiple  language  object  files  were  not  standardized. 

Furthermore  external  language  hooks  typically  do  not  perform  as  advertised.  Despite 
Herculean  efforts,  .several  RBM-related  re.search  efforts  have  failed  to  get  different 
levels  of  RBM  communicating  properly  due  to  this  vulnerability. 

Fortunately,  we  have  encountered  one  widely  available  IPC  technique  that 
is  likely  to  support  any  choice  of  programming  language,  operating  system  or 
hardware  architecture:  use  of  standard  Berkeley  Standard  Distribution  (BSD)  sockets 
compatible  with  the  Internet  Protocol  (IP)  (Stevens  9U).  IP-compatible  socket 
communications  are  implemented  on  all  computer  platforms,  and  are  available  as 
auxiliary  lunction  libraries  in  most  programming  languages  of  interest.  Use  of  sockets 
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has  several  added  benefits:  processes  can  run  independently,  interchangeably  and 
remotely  on  vehicle  processors  or  networked  workstations.  Current  NPS  AUV 
implementation  efforts  call  for  replacing  the  hard-wired  and  hard-coded  serial  and 
parallel  port  communications  between  processors  with  a  network  interface  for  each 
vehicle  microprocessor.  Building  a  small  network  i  .lal  to  the  vehicle  eliminates 
specialized  hardware  and  software  communications,  and  does  not  impose  a  noticeable 
performance  penalty.  It  also  permits  connecting  vehicle  proces.sors  and  processes  to 
any  remote  entity  on  the  Internet.  Even  tethers  between  an  unmanned  underwater 
vehicle  (UUV)  and  the  surface  can  be  Ethernet  connections  (Bellingham  94).  The 
strength  and  numerous  benefits  of  this  approach  have  led  us  to  network  all  possible 
components  of  AUV-related  software,  both  internal  and  external. 

3.  Execution  Level  Software 

Tlie  execution  program  is  a  new  and  extended  implementation  of  the  RBM 
execiiiion  level  for  the  NPS  AUV  (Brutzman  94e).  Originally  ba.sed  on  the  work  of 
(Marco  95)  and  others,  execution  now  includes  a  command  language  and  runs 
identically  on  the  laboratory  AUV  hardware  or  on  a  networked  SGI  workstation. 
Real-time  performance  for  a  10  Hz  control  cycle  was  maintained  in  each  environment. 
Code  development  on  workstations  enables  fa.ster  compilation  and  provides  more 
robust  debugging  tools  which  are  nontrivial  benefits  for  such  a  large  program. 

'’rinclpal  components  of  the  execution  program  include  invocation  and  stored  mission 
script  file  commands,  conanunlcations  to  the  tactical  level,  communications  to  the 
virtual  world,  vehicle  hardware  interfaces,  maneuvering  control  algorithms, 
standardized  telemetry  data  recording,  aitd  supplemental  mathematical  functions  to 
support  computational  geometry  calculations.  These  supplemental  functions  include 
normalize  (angle)  which  normalizes  an  angle  to  the  range  [()..7t),  normalize!  (angle) 
which  normalizes  an  angle  to  the  range  (-7t/2..n:/2],  and  atan2  (y,  a)  which  returns  the 
angle  to  a  point  in  the  proper  quadrant. 

Vehicle  control  algorithms  are  implemented  using  either  thrusters  (hovering 
modes),  planes/rudders/propellers  (cruise  modes)  or  all  in  combination.  Control 


algorithms  for  the  following  behaviors  are  included:  depth  control,  heading  control, 
open-loop  rotation,  open-loop  lateral  motion,  waypoint  following  and  hovering, 

(.'ontrol  algorithms  are  permitted  to  operate  both  thrusters  and  planes/rudders/propellers 
simultaneously  when  such  operation  does  not  mutually  interfere.  All  control  code  has 
been  developed  and  te.sted  in  conjunction  with  the  construction  of  the  hydrodynamics 
model  presented  in  Chapter  VI.  Design,  tuning  and  optimization  of  control  algorithms 
in  isolation  and  in  concert  is  the  subject  of  active  research  (Cristi  89)  (Yoerger  85,  90) 
(Papoulias  89.  91)  (Healey  89,  92b,  93)  (Fo.s.sen  94)  (Marco  95)  and  remains  an 
important  area  for  future  work.  Control  algorithm  robustness  is  a  particularly 
important  topic  since  potentially  fatal  nonlinear  instabilities  are  possible  and  vehicle 
reliability  is  paramount.  Individual  control  algorithms  created  as  part  of  this 
dissertation  follow. 

Rudder  steering  control  equations: 

^  ruddirbow  ^nukUrstern  (4.1) 

=  fc^nonnalize2(tlt-\|t,^,„^  +  k^-r  +  A/v 

Planes  depth  control  equations: 


5 


pUi/its  bow 


planes  stern 


(4.2) 


Not",  that  planes  and  rudder  are  each  constrained  <  ±  40°  to  prevent  excessive 
deflection  and  subsequent  reduction  of  control  above  ±  45°.  Planes  and  rudders  are 
zeroed  at  very  low  forward  speeds  in  order  to  eliminate  synchro  hunting  and 
chattering. 


f)9 


Vertical  thruster  depth  control  equations: 


yvaypoint  angle  =  iionnalize(atan2  -  y,  -  x))  ( 4.6 ) 


track  angle  =  nonnalizc  (waypoint  angle  -  ij/) 


along  track  distance  =  zos{track angle) -{waypoint  distance) 


cross  track  distance.  -  ~sm{trackangle)-{waypointdistance) 
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port,stbd  propeller  rpm 


Krop^iurHo^r '  distance) 

Ic  ■  u 

surge  haver 
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thruster ^  •  noniialize2  (lir  - 
+  k  .  •  r 

thruster  r 

-  l<-th^terhover<^’'^^^  truck distance) 

+  Ic  •  V 

jrvwtiy  hover 


thruster,,,^  ^  ■  normalize2  (t  - 

“  Ic  *  r 

^  thruster  r 

-  /^thruster  hcter '  distOnCe) 

+  Ic  •  V 

jfwcy 


(4.12) 


Assuciated  k  coolTicicats  are  all  positive  and  appear  in  Figure  4.5. 


4.  Comimiriicatioiis  Among  AUV  Processes  and  the  Virtual  World 

Since  RBM  is  a  multilevel  architecture,  communications  between  levels 
must  be  formally  defined.  Communications  between  robot  and  virtual  world  must  also 
be  clearly  specified.  Defining  communications  includes  establishing  a  physical  path 
for  rlaia  Irunsfer  as  well  as  defining  the  syntax  and  protocol  of  exchanged  messages. 
Design  objectives  include  reliability  and  clarity  so  that  messages  are  easily  created  and 
easily  uiulerstood,  either  by  software  processes  or  by  people. 
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Fijjure  4.5.  Control  algorithm  coefficients  from  mission. output. cunstants  file. 


Two  kinds  of  messages  are  defined  for  use  by  robot  and  virtual  world. 

The  first  is  the  telemetry  vector,  which  is  a  li.st  of  all  vehicle  state  variables  pertinent 
to  hydrodynamic  and  sensor  control.  TelerneU’y  vectors  are  passed  as  a  string  type. 
The  second  kind  of  messages  allowed  are  free-formal  commands.  Free-format 
comiTiand  messages  oi'e  also  string  types.,  starting  with  a  predefined  keyword  and 
followed  by  entries  which  may  optionally  have  significance  depending  on  the  initial 
keyword.  Messages  with  unrecognized  keywords  are  treated  as  comments.  These  two 
kinds  of  messages  (telemetry  and  commands)  can  be  u.sed  for  any  communication 
necessary  among  robot-related  entities.  Bmployment  of  sU'ing  types  facilitates  tran.sfer 
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between  different  architectures,  transfer  via  sockets,  and  file  storage.  String  types  also 
ensure  that  all  communications  are  readable  by  both  robot  and  human,  a  trait  that  is 
panicularly  u.seful  during  debugging.  .\n  open  format  for  command  messages  permits 
any  user  or  new  application  to  communicate  with  little  difficulty. 

Within  the  AUV.  the  basic  communications  flow  between  e.secution  level 
and  tactical  level  is  straightforward.  .All  telemetry  vectors  are  sent  from  the  execution 
le\el  to  the  tactical  level,  providing  a  steady  stream  of  time-sensitive,  rapidly  updated 
infonnation.  The  tactical  level  may  send  commands  to  the  execution  level  as  desired, 
and  the  execution  level  may  return  informational  messages  between  telemetry  vectors 
as  appropriate.  Nonadaptive  tactical  level  functionality  can  also  be  provided  by 
prescripted  mission  command  files.  Telemetry  vector  records  and  command  messages 
are  logged  in  separate  mission  output  files  for  post-mission  analysis  and  replay.  Each 
of  these  communications  message  tv’pes  has  been  implemented  and  tested  satisfactorily 
tBrutzman  94e».  Communication  protocols  between  tactical  level  and  strategic  level 
are  presented  in  (Byrnes  93)  and  arc  not  examined  here. 
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Specific  elements  of  the  telemetry  record  appear  in  Figure  4.5  below. 

Both  data  communications  internal  to  the  vehicle  (execution  and  tactical  levels)  and 
data  communications  external  to  the  vehicle  (execution  level  and  virtual  world)  utilize 
the  telemetry  vector  and  keyword  command  message  conventions.  Currently  the  data 
path  between  execution  and  tactical  levels  consists  of  paired  simplex  text  sti'eams  over 
serial  and  parallel  connections  between  the  two  microprocessors,  The  data  path 
bctuecn  the  execution  level  and  the  virtual  world  is  via  an  Ethernet  socket.  In  the 
future,  .serial  and  parallel  port  data  paths  between  the  execution  and  tactical  processors 
are  expected  to  be  replaced  by  Ethernet  sockets.  Figure  4.7  shows  physical  data  paths 
and  information  flow  both  internal  and  external  to  the  vehicle. 
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Figure  4.6.  Telemetry  vector  elements. 


74 


EGA 


GPS 

unit 


receiver 


C 


656-2037  modem 


card 


PCAny 

remote 


i  plug 

I  pODdl 


transputer 

boards 


transputer 

interface 


□ 


where 

control 


COM2;  sorlBl  -  or  -  COM2;  setial 


auvsim2 

GESPAC 

80386 

DR  DOS  6 

80387 

4M 

42MB 

1.44M 

16Mbz 

LfTl:  parallel 

(as  yet  unused) 


VT220  in  lab 
PCBridge  poolside 


Tactical 
Commands 
to  Execution 
V  Level  > 


COMl:  serial 


math  coprocessor 
momofy 

bard  drive  c;  d; 
3.5"  floppy  a: 


IT 


/TERM  sciUl 


Sensor  &  actuator 
digital-analog 
analog-digital 
convertor  b^ds 
ill  actual  vehicle 
/T2;  ST725  scanner 
(24°  I)  X  (r«) 
/T3:  STIOOO  profiler 
1°  conical  beam 


MFIA  port 


/P  parallel 


^  10  Hz 
Complete 
Telemetry 


'yMessage^ 

(TV  high  speed  19200] 
/T1  serial 


auvsiuil 


GESPAC 

68030 

OS-9 


yes 

2.5M 

20MB 

500K 

16Mhz 


math  coprocessor 
memory 

bard  drive  /hO  (lab  only) 
3.5*  floppy  /do  (lab  only) 


EITIERNET 
(In  lab 


^  Messages 

10  Hz 
Partial 
Telemetry  • 


connectioo 


vettdou) 


^  10  Hz 
Complete 
Telemetry 


Distributed  components  of 
Underwater  Virtual  World 


World 

Models 


Figure  4.7.  NPS  AUV  hardware  configuration  and  internal  interprocess  comniunication  (IPC). 
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The  telemetry  vector  serves  several  essential  purposes.  Ln  addition  to 
providing  a  steady  stream  of  information  from  the  execution  level  to  the  tactical  level, 
the  teler  letry  vector  also  serves  as  the  data  transfer  mechanism  between  execution 
level  and  '  irtual  world.  Efficient  communications  between  robot  and  virtual  world  are 
essential  if  rapid  real-time  10  Hz  robot  response  is  to  be  maintained.  The  telemetry 
record  is  a  conci.se  and  complete  way  to  support  all  of  these  data  communications 
requirements. 

Robot  execution  software  is  designed  to  operate  both  in  the  virtual  world 
and  in  the  real  world.  While  sensing  in  the  virtual  world,  distributed  hydrodynamics 
and  sonar  models  fill  in  pertinent  telemetry  vector  slots.  While  sensing  in  the  real 
world,  actual  sensors  and  their  corresponding  interfaces  fill  in  pertinent  telemetry 
vector  slots.  In  either  case,  the  remainder  of  the  robot  execution  program  which  deals 
with  tactical  communications,  command  parsing,  dynamic  control,  sensor  interpretation 
etc.  is  unaffected.  While  operating  in  the  virtual  world,  robot  propulsion  and  sensor 
commands  are  communicated  via  the  same  telemetry  vector.  While  operating  in  tlie 
real  world,  robot  propulsion  and  sensor  commands  are  sent  directly  to  hardware 
interfaces  for  propellers,  thrusters,  planes,  rudders,  sonar  steering  motors  etc.  Again 
almost  all  parts  of  the  robot  execution  program  are  completely  unaffected  by  this 
difference. 

The  telemetry  vector  is  therefore  the  key  data  transfer  mechanism  whereby 
vehicle  operation  remains  transparent  and  identical  either  in  the  virtual  world  or  in  the 
real  world.  Telemetry  vector  updates  also  define  the  communication  protocol  between 
execution  level  and  virtual  world.  As  might  be  expected,  the  execution  level  program 
follows  the  common  robotics  cyclic  paradigm  of  sense-decide-act.  Figure  4.8  shows 
in  detail  how  the  flow  of  control  proceeds  and  the  telemetry  vector  is  modified  during 
each  sense-decide-act  cycle.  Figure  4.9  provides  an  overview  of  the  telemetry  vector 
update  sequence  as  an  alternate  means  of  portraying  the  validity  of  this  approach. 
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Figure  4.8.  Data  flow  via  the  telemetry  vector  during  each  sense -decide-act  cycle. 
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Figure  4.9,  Telemetry  vector  modifications  during  each  sense-decide-act  cycle. 

E.  SUMMARY  AND  FUTURE  WORK 

This  chapter  discussed  general  underwater  robotics  hardware  considerations  and 
software  architectures.  Hardware  specifics  of  the  NFS  AUV  are  outlined. 

Descriptions  of  NFS  A'UV  software  focus  on  the  Rational  Behavior  Model  (RBM) 
architecture.  Multiple  operating  system  and  multiple  programming  language  strengths 
and  drawbacks  are  presented  from  the  perspective  of  several  years  of  implementation. 
Significant  contributions  to  NFS  AUV  execution  level  functionality  are  described  in 
detail,  including  a  tactical  command  language  and  multiple  dynamics  control 
algorithms.  Specifications  are  then  presented  for  communications  between  execution 
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level,  tactical  level  and  virtual  world.  A  combination  of  two  record  types  is  shown  to 
be  essential  and  complete:  the  telemetry  vector  of  vehicle  state,  and  free  format 
command  messages.  Telemetry  i.s  particularly  important  as  the  key  to  real-time  data 
transfer  and  interaction  between  the  robot  execution  level,  the  underwater  virtual  world 
and  disU'ibuted  users  observing  robot  operation. 

Future  work  includes  many  projects.  Completing  vehicle  repairs  and  duplicating 
test  results  from  prior  to  the  1994  mishap  are  nearly  complete.  The  execution  level 
program  created  for  this  dissertation  needs  to  be  reintegrated  with  the  repaired  vehicle. 
Integration  of  GPS,  internal  network  connections  between  microprocessors, 
implementing  strategic  and  tactical  levels  in  the  water,  and  porting  sonar  classification 
algorithms  are  all  planned  or  in  progress.  NPS  AUV  capabilities  are  nearly  ready  to 
support  A1  re, search  in  robot  ai'chitectures,  sensing,  classification  and  planning 
identically  in  the  water  or  in  the  virtual  world. 
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V.  THREE-DIMENSIONAL  REAL-TIME  COMPUTER  GRAPHICS 


A.  INTRODUCTION 

This  chapter  describes  the  principal  characteristics  needed  for  the  creation  of 
object-oriented  graphics  viewers  for  visualizing  a  large-scale  virtual  world.  Open 
standards,  portability  and  versatility  are  emphasized  over  platform-specific 
performance  considerations  in  order  to  support  scaling  up  to  very  large  numbers  of 
users,  platform  types  and  information  sources.  The  Open  Inventor  toolkit  and  scene 
description  language  has  all  of  the  functionality  needed,  and  it  is  described  briefly. 

The  potential  integration  of  network  connections  to  logically  extend  graphics  programs 
is  examined  in  detail. 

B.  DESIRED  CHARACTERISTICS  OF  GRAPHICS  VIEWER  PROGRAMS 

A  good  graphics  toolkit  for  building  a  virtual  world  viewer  has  many 
requirements  to  fill.  Rendered  .scenes  need  to  be  realistic,  rapidly  rendered,  permit 
user  interaction,  and  capable  of  running  on  both  lov/  end  and  high  end  workstations. 
Graphics  programmers  must  have  a  wide  range  of  tools  to  permit  interactive 
experimentation  and  scientific  visualization  of  real  world  datasets  (Nielsen  90) 
(Thalmann  90).  The  ability  to  read  multiple  data  formats  is  also  important  when  using 
scientific  and  oceanographic  datasets.  Scientific  data  format  compatibility  can  be 
provided  by  a  number  of  data  function  libraries  which  are  open,  portable,  reasonably 
well  standardized  and  usually  independent  of  graphics  tools  (Fortner  92)  (Rhyne  93b). 
Viewer  programs  need. to  be  capable  of  examining  high-bandwidth  information  streams 
and  large  archived  scientific  databases.  Thus  the  ability  to  preprocess  massive  datasets 
into  useful,  storable,  retrievable  graphics  objects  will  be  particularly  important  as  we 
attempt  to  .scale  up  to  meet  the  sophistication  and  detail  of  the  real  world.  Adequate 
standardization  of  computer  graphics  and  ponability  acro.ss  other  platforms  is  also 
desirable  but  has  been  historically  elusive. 
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C.  Open  Inventor 

Open  Inventor  is  an  object-oriented  3D  graphics  toolkit  for  graphics  applications 
design  (Strauss  92)  (Wernecke  y4a).  Based  on  the  Open  GL  graphics  library, 

Open  Inventor  provides  high-level  extensions  to  the  C++  (or  C)  programming 
language  and  a  scene  description  language.  It  is  designed  to  permit  graphics 
programmers  to  focus  on  what  to  draw  rather  that  how  to  draw  it,  creating  scene 
objects  that  are  collected  in  a  scene  database  for  viewpoint-independent  rendering. 
User-triggered  events  are  an  integral  part  of  the  graphics  rendering  engine  in  order  to 
permit  rapid  interactivity.  A  flexible  design  enables  prograrnmers  to  employ  a  variety 
of  object  representations  and  interaction  modes.  Object-oriented  functionality  allows 
users  to  customize  and  extend  toolkit  functionality  through  creation  of  new  classes, 
subclassing  and  inheritance  (Wernecke  94b). 

The  graphics  capabilities  of  Open  Inventor  are  extensive,  including  most  (if  not 
all)  of  the  functionality  described  in  canonical  computer  graphics  reference 
(Foley,  van  Dam  90),  as  well  as  hooks  to  X-Windows  and  Motif-compliant  window 
functions.  Open  Inventor  is  well  suited  to  build  graphics  viewers  for  interactive 
real-time  virtual  worlds.  It  has  been  used  to  produce  the  graphics  viewer  for  the 
NFS  AUV  underwater  virtual  world  (Brutzman  94e).  Particularly  important  and  useful 
capabilities  of  Open  Inventor  are  examined  in  the  following  paragraphs. 

1.  Scene  Description  Language 

The  ability  to  store  graphics  objects  as  readable,  editable  files  is  especially 
appealing  for  the  creation  of  large-scale  virtual  worlds.  Since  the  performance  of 
computer  graphics  is  highly  dependent  on  the  computational  complexity  of  scenes  to 
be  rendered,  it  is  inevitable  that  truly  large-scale  world  scene  databases  will  eventually 
overload  viewing  graphics  workstations.  Such  overload  will  occur  regardless  of  the 
efficiency  of  viewpoint  culling  algorithms  and  graphics  pipeline  optimizations,  unless 
partitionable  and  networked  scene  databases  iire  used.  Furthermore,  since  populating  a 
virtual  world  is  a  task  that  needs  to  be  open  and  accessible  to  large  numbers  of  people, 
an  open  graphics  data  standard  is  needed  for  virtual  world  construction.  The  ability  to 
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selectively  load  graphics  objects  and  scenes  from  files  is  also  an  important  distribution 
mechanism  which  can  take  advantage  of  World-Wide  Web  connectivity.  Thus  use  of 
Opeii  Inventor  scene  description  files  permits  individual  workstations  to  act  as 
graphics  file  .servers,  and  also  allows  a  large  variety  of  viewers  to  examine  individual 
graphics  objects. 

Elements  in  a  scene  graph  can  also  be  represented  by  icons  pertaining  to 
node  type  for  easy  reference.  An  abbreviated  scene  graph  for  the  NFS  AUV  graphics 
object  file  appears  in  Figure  5.1. 
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Figure  5.1.  Open  Inventor  scene  graph  for  the  NFS  AUV  graphics  model  {auv.iv). 


Open  Inventor  is  release  2  of  the  Inventor  toolkit  and  includes  numerous 
performance  improvements.  A  performance  optimization  guide  and  an  offline  scene 


82 


graph  optimization  tool  have  also  been  included.  These  are  both  useful  for  tuning 
Open  Inventor  applications  to  achieve  near-optimal  graphics  pipeline  performance. 

2.  Open  Standards  and  Portability 

Silicon  Graphics  Inc.  (SGI)  is  the  preeminent  company  producing  3D 
computer  graphics  workstations  and  software,  including  Open  Inventor.  SGI  has  made 
a  corporate  commitment  to  maintain  the  Open  Inventor  scene  description  language  as 
theii  preferred  open  standard  graphics  file  format.  Although  Open  Inventor  syntax  is 
not  in  the  public  domain  like  Open  GL,  SGI  has  further  committed  to  maintaining 
backwards  compatibility  through  future  versions  of  Open  Inventor.  (Wernecke  94c) 
provides  a  methodology  for  writing  translators  from  other  scene  description  languages 
to  Open  Inventor,  further  encouraging  nonproprietary  portability  among  graphics 
models.  Numerous  third-party  vendors  are  porting  the  Open  GL  and  Open  Inventor 
programming  environments  to  other  operating  systems  and  architectures  (Macintosh, 
Windows,  Sun,  HPUX  etc.),  further  extending  the  expected  portability  of 
Open  Inventor  models  and  viewers.  Ubiquitous  portability  for  analytic,  hypermedia, 
network,  multicast  and  graphics  tools  is  an  extremely  desirable  feature  for  virtual 
world  model  builders.  Suitability  of  Open  Inventor  for  this  role  was  recently 
underscored  by  an  open  working  group  examination  and  ballot  which  chose 
Open  Inventor  over  a  dozen  competitors  as  the  baseline  for  the  draft  Virtual  Reality 
Modeling  Language  (VRML)  specification  (Pesce  94)  (Bell  94). 

Open  Inventor  file  formats  can  be  specified  as  ASCII  (plain  text)  or  binai7 
format  files.  Open  Inventor  specifications  require  that  the  first  line  of  any  file  (ASCII 
or  binary)  contain  a  plain-text  declaration  of  Inventor  version  number  for  forward 
compatibility  with  current  and  future  file  readers.  Binary  file  formats  are  not  openly 
published  by  SGI  but  binary  file  readers  are  openly  available,  a  design  decision  made 
to  ensure  efficient  backward  format  compatibility  in  future  versions.  As  might  be 
predicted  from  an  information-theoretic  perspective,  compressed  ASCII  Open  Inventor 
files  are  about  the  same  size  as  binary  files.  Thus  compressed  ASCII  (i.e.  human 
readable)  Open  Inventor  files  are  suitable  for  network  distribution  with  minimal 
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bandwidth  load.  Open  Inventor  scene  description  files  in  text  format  (or  forthcoming 
VRML  file  format  extensions)  are  therefore  excellent  candidates  for  object  definitions 
in  a  large-scale  virtual  world. 

3.  Behavior  Animation  through  Data  Sensors,  Timer  Sensors  and  Engines 

Once  graphics  objects  ai'e  specified,  most  graphics  programmers  expend  a 
great  deal  of  effort  connecting  devices,  data  or  algorithms  to  animate  the  scene.  These 
animation  techniques  are  typically  the  heart  of  any  graphics  program  and  the  specific 
reason  that  most  graphics  programs  are  needed,  because  the  only  way  to  explicitly 
specify  behaviors  is  through  the  programming  language  itself.  This  also  means  that 
most  graphics  scenes  are  not  portable  as  scene  description  files,  only  as  programs. 

Open  Inventor  significantly  extends  the  capabilities  of  scene  description  files  by 
providing  data  sensors,  timer  sen.sors  and  behavioral  "engines"  which  can  be  connected 
to  automatically  animate  elements  of  the  scene  graph.  Sensor  and  engine  functionality 
and  connections  can  still  be  written  out  to  file,  preserving  behavioral  connections. 

Behavioral  extensions  to  a  scene  description  language  are  very  useful.  A 
simple  example  of  engine  functionality  from  (Wernecke  94a)  is  used  to  animate  the 
static  JASON  ROV  graphics  model  (which  was  originally  donated  via  electronic  mail). 
A  graphics  rendering  of  JASON  appears  in  Figure  5.2.  This  figure  moves  about  the 
base  of  an  oil  platform  in  the  underwater  virtual  world.  The  corresponding  animation 
scene  graph  is  shown  in  Figure  5.3.  Further  work  on  extending  behavioral  definitions 
to  include  detailed  physically-based  dynamics  is  desirable  and  has  been  demonstrated 
independently  (Zyda  92a). 
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Figure  5.2.  Open  Inventor  rendering  of  JASON  ROV  graphics  model. 


D.  NETWORK  LINKS  TO  GRAPHICS  OBJECTS 

As  the  use  of  the  DIS  standard  becomes  widespread,  implementation  of  DIS 
library  functionality  will  be  more  frequent  and  a  good  candidate  for  tool  automation. 
Currently,  vehicle  graphics  model  connections  to  a  DIS  interface  can  be  manually 
programmed  or  specified  through  initialization  file.s  within  virtual  world  viewers  such 
as  NPSNET  (Pratt  93).-  Increased  user  familiarity  and  availability  of  DIS  libraries  will 
increase  the  population  of  DIS-compatible  graphics-based  entities.  Creation  of 
DIS-compliant  physical  and  graphical  models  is  becoming  progressively  easier. 

A  recommended  area  for  future  implementation  is  the  use  of  the  DIS  Message 
PDU  to  augment  tlie  announced  arrival  of  new  entities.  The  Message  PDU  might 
specify  Internet  Universal  Resource  Locator  (URL)  addresses  which  contain  the 
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Figure  5.3.  Engine  animation  scene  graph  for  JASON  ROV  wandering  behavior. 

graphics  model  and  operational  characteristics  for  entity  types  that  were  previously 
unknown  or  unavailable.  Such  an  extension  permits  the  introduction  of  new  DIS 
entities  automatically  without  requiring  pre-exercise  coordination.  Another  interesting 
use  of  DIS  Message  PD  Us  in  this  underwater  virtual  world  application  might  be  to 
relay  the  robot  commands  which  are  being  spoken  to  all  viewers.  Possible  formats  for 
this  information  include  the  original  text,  or  a  URL  pointing  to  the  synthesized  audio 
file  to  minimize  duplicate  sound  server  queries. 

As  the  use  of  the  World-Wide  Web  becomes  ubiquitous,  the  placement  of 
graphics  objects,  images  and  datasets  at  well-defined  network  locations  on  public 
servers  will  become  conrmonplace.  Individual  and  institutional  domain  experts  can 
maintain  and  update  sophisticated  world  databases  for  open  retrieval  on  demand. 
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Textures  conesponding  to  specific  locations  in  terrain  datasets  can  be  used  to  map 
available  imagery  to  the  real  world.  An  example  texture  image  manually  collected 
from  a  MBARI  ROV  Ve/itaiia  video  stream  via  the  MBone  is  shown  in  Figure  5.4. 


Figure  5.4.  Example  Monterey  Canyon  bottom  image  recorded  via  MBone  video 
from  the  MBARI  ROV  Ventana,  This  image  is  applied  as  a  bottom 
texture  in  the  underwater  virtual  world.  Used  with  permission. 


Widespread  application  of  textures  is  particularly  suited  to  the  automatic 
collection  of  image  data  by  robots.  Automated  collection  and  recording  of  video 
mosaics  can  be  registered  with  terrain  and  stored  on  public  file  servers  to  build 
textured  maps  for  large-scale  virtual  worlds.  Extension  and  standardization  of  such 
approaches  is  also  furtliered  by  the  combination  of  graphics  and  networking 
mechanisms  propo.sed  in  the  draft  VRML  specification  (Bell  94). 


X7 


E.  SPECIAL  METHODS 

Much  more  work  is  possible  to  extend  and  augment  the  graphics  viewer.  User 
interface  extensions  will  be  focused  exclusively  on  X-Windows  Motif,  TkyTcl 
lOsterhout  94)  or  hypertext  markup  language  in  order  to  maximize  portability.  Sound 
and  data  sonification  can  add  an  extra  dimension  to  the  display  of  scientific 
information.  Automatically  embedding  hypermedia  links  inside  scene  graphs  is 
expected  to  be  possible  using  VRML  extensions  to  Open  Inventor,  hopefully  through 
use  of  embedded  comments  or  future  compatibility  between  the  two  scene  graph 
languages. 

F.  SUMMARY  AND  FUTURE  WORK 

The  characteristics  of  an  open  graphics  viewer  for  underwater  virtual  world 
rendering  are  presented.  Principal  requirements  include  capable  flexibility  for 
scientific  visualization  and  portability  across  multiple  hardware  and  software 
platforms.  Open  Inventor  is  demonsuated  as  an  effective  programming  toolkit  in  this 
regard,  'fhe  desirability  of  scaling  to  very  large  numbers  of  users  and  information 
sources  leads  to  a  great  deal  of  interesting  future  work  which  can  extend  graphics 
capabilities  by  embedding  network  capabilities.  The  use  of  multicast  DIS  message 
PDUs  for  distribution  of  World-Wide  Web  pointers,  extending  scene  description 
languages  to  include  dynamic  behaviors  and  the  proposed  functionality  of  the  Virtual 
Reality  Modeling  Language  (VRML)  are  especially  promising  possibilities. 


88 


VI.  UNDERWATER  VEHICLE  DYNAMICS  MODEL 
A.  INTRODUCTION 

Underwater  vehicle  design  and  construction  is  almost  completely  preoccupied 
with  environmental  considerations.  The  ocean  completely  surrounds  the  vehicle, 
affects  the  slightest  nuance  of  vehicle  motion  and  poses  a  constant  hazard  to  vehicle 
suiA-ivability.  Many  of  the  effects  of  the  surrounding  environment  on  a  robot  vehicle 
are  unique  to  the  underwater  domain.  Vehicles  move  through  the  ocean  by  attempting 
to  control  complex  forces  and  reactions  in  a  predictable  and  reliable  manner.  Thus 
understanding  these  forces  is  a  key  requirement  in  the  development  and  control  of 
both  simple  and  sophisticated  vehicle  behaviors.  Unfortunately,  the  underwater 
vehicle  development  community  has  been  hampered  by  a  lack  of  appropriate 
hydrodynamics  models.  Currently  no  single  general  vehicle  hydrodynamics  model  is 
available  which  is  computationally  suitable  for  predicting  underwater  robot  dynamics 
behavior  in  a  real-time  virtual  world. 

The  intended  contributions  of  the  hydrodynamic  model  in  this  dissertation  are 
clarity,  analytical  correctness,  generality,  nomenclature  standardization  and  suitability 
for  real-time  simulation  in  a  virtual  world.  Many  interacting  factors  are  involved  in 
underwater  vehicle  dynamics  behavior.  These  factors  can  result  in  oscillatory  or 
unstable  operation  if  control  algorithms  for  heading,  depth  and  speed  control  do  not 
take  into  account  the  many  complex  possibilities  of  vehicle  response.  Laboratory 
modeling  of  hydrodynamics  response  to  underwater  vehicle  motion  is  essential  due  to 
the  need  to  avoid  control  law  errors,  sensing  errors,  navigational  errors,  prematurely 
depleted  propulsion  endurance,  loss  of  depth  control,  or  even  catastrophic  failure  due 
to  implosion  at  crush  depth.  An  analytically  valid  hydrodynamics  model  must  be 
based  on  physical  laws  and  sufficiently  accurate  for  the  study  and  development  of 
robust  control  laws  that  work  under  a  wide  range  of  potential  vehicle  motions.  The 


89 


real-time  hydrodynamics  model  is  therefore  an  essential  component  of  a  robot-centered 
underwater  virtual  world, 

Detailed  analysis  of  underwater  vehicle  hydrodynamics  behavior  is  beyond  the 
current  state  of  the  art  using  real-time  simulation  techniques.  In  many  cases,  detailed 
data  on  underwater  vehicle  hydrodynamics  response  is  unavailable  even  in  real  world 
test  programs.  Development  of  a  general  physics-based  real-time  model  fills  a  gap  in 
the  robotics  and  simulation  literature  that  does  not  exist  for  corresponding  robot 
operating  environments  such  as  indoors,  space  or  air.  Inclusion  of  an  analytically 
correct  and  verifiable  hydrodynamics  model  in  an  underwater  virtual  world  will  permit 
meaningful  and  timely  analysis  of  realistic  robot-environment  interactions. 

It  must  be  noted  that  "correctness"  may  not  be  rigorously  possible  for  any 
h ydrodynamics  model.  So  many  interrelated  factors  are  present  that  precise  testing 
and  verification  of  all  parameters  is  unlikely  or  impossible.  While  a  model  of 
hydrodynamics  forces  may  never  be  perfect,  it  can  achieve  sufficiency  in  that  vehicle 
responses  can  be  predicted  by  physical  laws  at  a  level  of  detail  adequate  to  develop, 
test  and  evaluate  vehicle  performance  under  a  variety  of  control  laws.  The 
quantifiable  goal  for  correctness  in  this  work  is  a  generalizable  model  that  predicts 
vehicle  physical  response  with  sufficient  rapidity  and  accuracy  to  permit  equivalent 
robot  behavior  whether  in  the  laboratory  or  underwater.  Such  a  model  will  also  enable 
realistic  and  repeatable  design  and  evaluation  of  vehicle  control  systems,  again  either 
in  the  laboratory  or  underwater. 

The  model  presented  herein  was  intentionally  developed  with  complete 
independence  from  classified  U.S.  Navy  research  on  vehicle  hydrodynamics.  No 
classified  documents  were  consulted  during  the  literature  search  for  this  work. 

Research  statements  and  conclusions  are  derived  solely  from  the  extensive  open 
literature  on  hydrodynamics,  in  no  way  confirming,  denying  or  implying  the  existence 
of  similar  work  in  the  classified  arena.  A  good  unclassified  tutorial  on  the 
fundamentals  of  naval  submarine  design  is  (Jackson  92).  Details  on  experimentally 
and  analytically  developing  submarine  hydrodynamics  models  are  in  (Huang  88). 
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Unclassified  overview  descriptions  of  the  use  of  a  hydrodynamics  model  in  the  design 
and  testing  of  the  ARP  A/Navy  Unmanned  Underwater  Vehicle  (UUV)  are  in 
(Pappas  91)  and  (Brancart  94).  Primary  references  for  this  dissertation  are 
(Healey  92c,  93)  and  (Fossen  94),  Finally,  a  large  number  of  papers  and  theses  have 
been  written  at  the  Naval  Postgraduate  School  (NPS)  pertaining  to  hydi’odynamics 
modeling  of  the  NPS  AUV,  and  each  contributed  to  the  theoretical  and  experimental 
knowledge  presented  here  (Papoulias  89)  (Cristi  89)  (Jurewicz  90)  (Zyda  90) 

(Warner  91)  (Bahrke  92)  (Brutzman  92a)  (Brutzman  92c)  (Cooke  92a,  92b)  (Cody  92) 
(Brown  93)  (Belton  93)  (Haynes  93)  (Zehner  93)  (Cottle  93)  (Torsiello  94)  and 
(Marco  95). 

This  chapter  begins  with  a  comparison  of  dynamics  considerations  for  different 
vehicles  and  their  respective  environments.  A  description  of  world  and  body 
coordinate  systems  is  used  to  derive  Euler  angle  kinematics  equations  of  motion.  A 
rigorous  real-time  six  degree-of-freedom  hydrodynamics  model  is  then  derived  based 
on  the  work  of  (Healey  92c,  93)  (Fo.s.sen  94)  and  others.  Verified  coefficient  values 
for  the  NPS  AUV  II  Phoenix  vehicle  are  included  and  experimental  model  coefficient 
determination  for  other  vehicles  is  considered.  Different  representations  for 
calculating  vehicle  motion  are  compared  using  Euler  angle  or  quaternion  methods. 
Network  protocol  considerations  are  then  examined  for  integration  of  the 
hydrodynamics  model  into  a  wide-scale  distributed  virtual  world  using  the  Distributed 
Interactive  Simulation  (DIS)  protocol.  A  general  object-oriented  networked 
underwater  rigid  body  class  hierai'chy  is  presented.  Simulation  of  on-board  sensors  is 
considered,  and  the  relationship  of  robust  control  system  design  to  hydrodynamics 
modeling  is  briefly  examined.  Finally,  future  work  is  discussed  concerning  tether 
dynamics,  ocean  current  modeling  and  collision  detection,  and  addition  of 
hydrodynamics  models  to  on-board  robot  autopilots. 
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B.  COMPARISON  OF  DYNAMICS  FOR  GROUND  VEHICLES,  AIR 

VEHICLES,  SPACE  VEHICLES,  SURFACE  SHIPS  AND 

UNDERWATER  VEHICLES 

Dynamics  models  are  available  for  a  wide  variety  of  vehicles  and  articulated 
bodies  (Fu  K7)  (Greenwood  XK)  (Wilhelms  91)  (Green  91)  (Barzel  92)  (Witkin  93).  In 
every  case  it  is  desirable  that  the  physical  laws  governing  vehicle  interaction  with  its 
environment  be  specified  as  exactly  and  correctly  as  possible.  Constraints  on  vehicle 
motions  vary  greatly  during  interaction  with  different  environments.  A  brief 
examination  of  each  basic  type  of  vehicle  environment  and  the  physics  as.sociated  with 
those  environments  is  useful  in  understanding  the  nature  of  hydrodynamics  modeling. 

One  well-specified  objective  of  the  hydrodynamics  model  is  to  repeatedly 
determine  system  state,  defined  as  follows: 

The  state  of  a  system  is  a  mathematical  structure  containing  a  set  of  n 

variables  Xi(t),X2(t),...,Xi(t) . xjt),  called  the  state  variables,  such  that  the  initial 

values  Xi(tf,)  of  this  set  and  the  system  inputs  u/t)  are  sufficient  to  uniquely 
describe  the  system’s  future  response  for  t  k  tg.  There  is  a  minimum  set  of  state 
variables  which  is  required  to  represent  the  system  accurately.  The  m  inputs, 

Uiitj.Uiit) . u,{t) . w„(f),  are  detemiinistic;  i.e.,  they  have  specific  values  for  all 

values  of  time  f  >  (D’Azzo  88) 

An  alternative  definition  of  state  is  the  minimum  set  of  valuables  from  which  the 
position,  orientation  and  combined  kinetic  and  potential  energy  of  the  vehicle  can  be 
determined  uniquely.  Unique  descriptions  of  vehicle  state  also  require  inclusion  of  an 
accompanying  dynamics  model,  consisting  of  an  equal  number  of  simultaneous 
equations  as  there  are  state  variables  expres.sed  in  list  order  form.  One  further 
clarification  of  the  quoted  definition  is  that  input  forcing  functions  need  not  be 
deterministic  and  can  be  stochastic. 

A  key  chitracterization  of  any  set  of  dynamics  laws  is  whether  the  system  is 
holonomic  or  nonholonomic.  These  two  terms  are  frequently  misunderstood  and  merit 
definition  here.  Holonomic  describes  motion  that  includes  no  constraints  between  any 
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of  the  independent  state  variables  of  a  rigid  body;  literally,  the  motion  is  "whole." 
Ordinarily,  for  a  single  rigid  body,  twelve  state  variables  pertain  to  holonomic  motion, 
corresponding  to  six  physical  degrees  of  freedom.  Specifically  these  twelve  state 
variables  include  six  values  for  linear  and  rotational  velocities,  and  six  values  for 
position  and  orientation  (i.e.  posture).  Nonholonomic  motion  indicates  that  there  are 
interdependent  constraints  on  rigid  body  motion,  or  that  variation  in  one  or  more  of 
these  state  variables  is  dependent  upon  or  con.strained  by  other  state  variables. 
Nonholonomic  constraints  prevent  direct  integration  of  accelerations  and  velocities  into 
posture.  Examples  of  nonholonomic  motion  constraints  include  a  rolling  ball  that  can 
not  slip  (i.e.  lose  traction)  relative  to  a  surface,  or  parallel  parking  an  automobile 
where  no  sideslip  is  allowed.  Another  example  is  a  falling  cat  as  it  moves  in  midair, 
which  must  obey  the  conservation  law  for  angular  momentum.  In  each  case, 
nonholonomic  constiaints  limit  the  freedom  of  motion.  Further  descriptions  and 
recent  research  in  nonholonomic  motion  are  examined  in  (Greenwood  88), 

(Latombe  91)  and  (Li,  Canny  93). 

I.  Ground  Vehicles 

Ground  vehicles  are  constiained  by  contact  with  a  surface  that  generates 
normal  and  frictional  forces  between  vehicle  and  terrain.  On  a  surface  that  is 
predominantly  planar,  high  frequency  vertical  components  of  motion  are  relatively 
small  contributors  to  horizontal  motion,  particularly  since  they  may  be  intentionally 
damped  or  compensated  for  by  mechanical  devices  such  as  shock  absorbers,  tire 
wheels,  suspension  systems  or  flexible  legs.  Vertical  forces  merely  displace  the 
vehicle  a  small  and  independent  amount  in  the  vertical  direction  with  little  effect  on 
horizontal  velocity.  Travel  up  and  down  hills  can  add  a  vertical  component  to  the 
direction  of  motion  but  does  not  fundamentally  change  the  two-dimensional  nature  of 
vehicle  ti-avel  relative  to  the  surface.  Often  simple  kinematic  models  suffice  for 
wheeled  robots  (Alexander  90),  especially  when  surface  vehicle  motion  is  slow  and 
constrained  to  follow  roads  and  tracks  when  outside  or  fiat  floor  surfaces  when 
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indoors.  Legged  robot  interactions  with  surfaces  are  complex  and  require  dynamics 
models  (Frank  69)  (McGhee  79)  (Raibert  86). 

Ground  vehicle  motion  is  complicated  by  operation  at  the  interface  between 
tv-o  media:  ground  and  atmosphere.  Aerodynamics  loading  is  usually  secondary,  but 
must  be  considered  during  high  wind  conditions  or  in  conjunction  with  the  response  at 
high  relative  speeds  between  robot  and  ground.  Detailed  analysis  of  the  mechanisms 
governing  vehicle  interaction  with  various  surface  types  is  extremely  complex, 
particularly  during  traversal  of  rough  terrain  by  off-road  vehicles  (Bekker  56) 

(Bekker  69).  Fortunately  for  most  robot  operations,  however,  the  dynamics  of 
ground-vehicle  interaction  rarely  has  a  direct  bearing  on  vehicle  stability,  reliability, 
navigation  or  higher-level  control  functions.  Ground  robots  may  further  attempt  to 
take  advantage  of  ground  conuict  for  navigational  purposes  by  measuring  wheel 
rotation,  frictional  contact  or  leg  motion  (MacPherson  93).  In  this  overall  robotics 
context,  regardless  of  how  motion  is  estimated,  ground  vehicle  dynamic  behavior  is 
often  well  approximated  by  kinematic  models,  with  dynamics  considerations  typically 
having  only  secondary  effects  on  robot  control  logic,  Ground  vehicles  remain  highly 
constrained  by  the  nonholonomic  nature  of  contact  between  vehicle  and  environment, 

2.  Air  Vehicles 

Air  vehicles  differ  from  ground  vehicles  in  that  vertical  components  of 
motion  are  coupled  to  interactions  in  the  local  horizontal  plane.  Interactions  with  the 
atmosphere  due  to  aerodynamic  forces  have  a  significant  effect  on  vehicle  motion. 
There  is  no  direct  constraint  on  air  vehicle  posture  analogous  to  ground  contact,  and 
aircraft  flight  dynamics  are  holonomic.  Fixed  wing  air  vehicle  dynamics  are  typically 
dominated  by  the  high  speed  forward  motion  which  is  necessary  to  generate  sufficient 
lift  to  carry  vehicle  weight.  The  density  of  air  is  low,  and  thus  vehicle  accelerations 
do  not  produce  significant  acceleration-related  aerodynamic  forces.  This  means  that 
the  atmosphere  does  not  induce  significant  "added  mass"  effects  (Yuh  90). 

Helicopters  differ  in  many  respects  from  fixed  wing  aircraft.  Helicopter 
rotors  have  high  degrees  of  freedom  due  to  multiple  rotor  blades,  each  of  which  have 
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individual  mechanical  articulations  for  twist  and  lag.  Additional  degrees  of  freedom 
occur  due  to  many  factors,  including  flexible  rotational  twist  of  individual  blades,  tail 
rotors,  optional  jet  assist,  and  airstream  interactions  during  phenomena  such  as 
turbulence  and  ground  effects.  De.spite  this  high  degree  of  complexity,  helicopter 
dynamics  can  be  well  .specified  (Saunders  75),  modeled  in  real  time  (Williams  85) 
(Offenbeck  85)  and  visually  verified  during  repeated  testing. 

In  fixed-wing  aircraft,  wings  support  the  weight  of  the  vehicle  and  also 
support  control  suifaces.  Although  aircraft  weight  and  balance  variations  can  produce 
large  effects,  they  are  ordinarily  maintained  within  carefully  specified  ranges  that  the 
wings  and  contiol  surfaces  can  accommodate.  Wing  aerodynamics  have  been 
extensively  studied  under  steady  motion  conditions  and  are  easily  generalizable.  Thus 
the  overall  lift  and  drag  behavior  of  most  air  vehicles  can  be  predicted  with  reasonable 
accuracy  and  in  real  time  using  simultaneous  differential  equation  solutions 
(Cooke  y2a.  92b)  (Rolfe  Hb).  Nevertheless  precise  localized  modeling  of 
high-performance  aircraft  dynamics  for  design  purposes  does  not  pemiit  general 
closed-form  solutions.  Feasible  solutions  for  precision  design  include  massive  finite 
element  analysis,  a  large-scale  computational  fluid  dynamics  (CFD)  approach,  and 
wind  tunnel  testing,  These  approaches  do  not  suit  real-time  application  since 
large-scale  finite  element  analysis  and  CFD  are  considered  computational 
"grand  challenges"  (Draper  94).  Scientific  visualization  and  virtual  reality  techniques 
have  also  been  applied  with  some  success  in  advanced  aircraft  design  (Bryson  91). 
These  complex  advanced  techniques  are  special  cases,  however,  compared  to  the 
general  state  of  the  ait  in  aircraft  design.  Aircraft  dynamics  are  typically  well  defined, 
well  understood,  and  directly  verifiable  through  visual  examination  during  in-flight 
tests  and  wind  tunnel  experiments. 

3.  Space  Vehicles 

Space  vehicle  dynamics  are  principally  determined  by  orbital  mechanics. 
Friction  between  vehicle  and  environment  is  almost  non-existent,  and  thus  the 
equations  of  motion  include  only  gravitational,  inertial  and  thrust  effects.  There  are 
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few  (if  any)  uncertain  vehicle  parameters,  and  vehicle  postures  can  be  tiacked  both 
locally  and  remotely  with  great  precision.  Interestingly,  ballistic  missiles  can  be 
considered  a  special  class  of  orbital  vehicle  whose  path  intersects  the  Earth’s 
surface  (Bate  71).  Many  summaries  of  spacecraft  dynamics  {'"e  available,  including 
(Larson  92)  (Bate  71)  (Allen  91).  Translation  and  angular  movements  for  orbital 
vehicles  may  be  counterintuitive  from  an  everyday  perspective  but  can  be  calculated 
exactly.  Under  some  conditions  this  motion  can  be  nonholonomic,  since  six 
degree-of-freedom  space  vehicles  controlled  by  internal  motors  must  still  conserve 
angular  momentum.  If  thrusters  are  used,  spacecraft  motion  is  holonomic. 

Additionally  some  orbital  vehicles  (such  as  an  astronaut  in  a  space  suit)  have  a 
variable  mass  distribution  and  may  not  strictly  behave  as  rigid  bodies.  Other  motions 
at  higher  freciuencies  may  exist  if  vehicle  components  are  flexible,  in  which  case 
detailed  partial  differential  equation  solutions  are  required  for  twist,  bending,  shear  and 
axial  deformation.  Nevertheless,  in  many  respects  the  mathematical  and  empirical 
foundations  of  equations  predicting  spacecraft  motion  are  the  best  defined,  best 
understood  and  most  directly  verifiable  of  any  vehicle  type. 

4.  Surface  Ships 

Surface  ship  dynamics  are  unconstrained  in  six  degrees  of  freedom  and  ai’e 
holonomic.  The  vertical  component  of  motion  is  primarily  determined  by  vei7  large 
counterbalancing  values  of  weight  and  displacement  which  keep  the  ship  at  the  surface 
of  the  ocean.  Vertical  posture  changes  due  to  pitch  and  roll  variations  normally 
average  to  zero  over  long  time  .scales,  due  to  the  hydrostatic  righting  moments 
produced  by  the  cunent  location  of  the  center  of  buoyancy  relative  to  the  center  of 
gravity.  Equipment,  personnel  and  overall  ship  trajectory  are  typically  unaffected  by 
the  time  rates  of  change  of  components  of  motion,  either  by  design  or  seafaring 
practice.  Changes  in  vertical  motion  are  strongly  affected  by  the  changing  buoyancy 
of  the  vehicle  which  varies  as  water  displacement  changes.  As  a  result,  a  paramount 
criterion  in  ship  design  is  that  the  vehicle  be  reliably  stable  and  self-righting,  under 
both  normal  and  damaged  conditions.  Interactions  of  greatest  interest  between  vehicle 
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and  environment  usually  pertain  to  the  travel  of  the  ship  along  the  horizontal  ocean 
surface.  Nevertheless  motion  is  greatly  complicated  by  vehicle  operation  at  the 
interface  between  two  media:  ocean  and  atmosphere.  Except  for  sailing  vessels  and 
ships  with  low  headway,  aerodynamic  forces  tend  to  be  weaker  than  hydrodynamic 
forces.  Regardle.ss  of  surface  ship  type,  both  .sets  of  forces  can  be  significant  and  both 
must  be  considered  simultaneously. 

Hydrodynamics  and  navigation  of  surface  vessels  are  complex  subjects  but 
have  been  extensively  .studied,  with  a  comprehensive  compendium  of  knowledge  in 
(Lewis  XX)  and  more  examples  in  (Fossen  94)  (Covington  94)  (Maloney  85). 
Piedictable  cour.ses,  predictable  speeds,  .sideslip  (lateral  motion  due  to  momentum 
during  turns)  and  gradual  smooth  changes  in  vehicle  velocity  are  all  typical  of  surface 
ship  behavior.  Behavior  of  surface  vehicle  dynamic  response  can  be  tested  and 
verified  visually.  Tow  tank  verification  is  also  possible,  but  tow  tank  testing  is 
expensive  and  is  limited  by  two  competing  requirements.  Tetd  tank  model  designers 
attempt  to  maintain  inverse  proportionality  constraints  between  the  square  root  of 
model  scale  and  maximum  water  speed  (Froude  number),  along  with  the  concurrent 
desirability  of  simultaneously  maintaining  drag  coefficient  (Reynolds  number) 
similarity.  Tradeoffs  between  these  competing  requii'ements  aie  necessary  when 
building  and  testing  scale  models.  Wind  and  wave  models  can  be  represented  by 
complex  spectral  functions  that  are  computationally  expensive  and  difficult  to  specify 
(Fossen  94).  Nevertheless  environmental  disturbances  can  be  separately  computed  and 
independently  added  to  hydrodynamic  forces  based  on  the  principle  of  superposition 
(Lewis  X8)  (Fossen  94).  Additionally,  linear  models  are  available  for  wind  and  wave 
behavior  which  permit'reasonably  accurate  real-time  simulation  (Fossen  94) 

(Covington  94).  Models  of  similar  or  lesser  complexity  are  also  available  for 
hovercraft  vehicles  (Amyot  89).  In  summary,  modeling  of  surface  ship  dynari  ;s  is 
reasonably  well  defined,  well  studied  and  directly  verifiable  during  testing. 


97 


5.  Underwater  Vehicles 

Underwater  vehicle  dynamics  may  be  as  complex  and  difficult  to  model  as 
any  of  these  regimes,  principally  due  to  difficulties  in  observing  and  measuring  actual 
underwater  vehicle  hydrodynamics  response.  Submerged  vehicle  motion  is  not 
constrained  in  the  vertical  direction.  For  some  unmanned  vehicles,  posture  must  be 
resU'icted  to  only  reach  moderate  pitch  and  roll  angles.  This  constraint  is  imposed 
since  pointing  vertically  or  inverting  can  cause  equipment  damage  or  dangerous 
control  response.  Very  large  angles  of  attack  between  vehicle  orientation  and  vehicle 
direction  of  motion  are  possible.  The  effects  of  forces  and  moments  can  all  be 
cross-coupled  betw  n  vertical,  lateral  and  horizontal  directions.  Motion  in  world 
coordinates  is  only  calculable  after  all  effects  in  the  body  coordinate  system  are 
comprehensively  predicted.  Actual  vehicle  motion  can  be  watched  remotely  only  with 
very  low  precision  or  (more  often)  not  at  all.  Tow  tank  testing  imposes  unrealistic 
external  force  constraints  which  are  otherwise  not  present.  The  effects  of  the 
suiTo unding  environment  are  relatively  large  and  significant,  so  much  so  that  the 
adjacent  water  tends  to  be  accelerated  along  with  the  vehicle  and  can  be  thought  of  as 
an  "added  mass."  Together  these  challenges  make  underwater  vehicle  physical 
response,  guidance  and  control  an  extremely  difficult  dynamics  problem. 

There  are  over  one  hundred  pertinent  coefficients  and  variables  relating  to 
the  linear  and  non-linear  coupled  effects  of  lift,  drag,  added  mass  and  propulsion  in 
the  model  of  this  dissertation.  Although  a  number  of  these  coefficients  ai'e  of 
second-order  eftect  or  negligible  importance,  determination  of  primaiy  coefficient 
values  is  very  difficult  and  expensive.  These  problems  are  frequently  compounded 
when  the  subject  vehicle  has  an  open  frame  with  irregular  surfaces,  or  when  a  towed 
tether  is  attached. 

It  is  conceivable  that  an  even  more  complex  and  fundamental  model  to 
calculate  underwater  vehicle  dynamics  might  be  derived  than  is  presented  here. 
Specifically,  the  Navier-Stokes  fluid  flow  differential  equations  might  be  applied  in  a 
CFD  vehicle-fluid  coupled  interaction  model  (Ren  93).  Closed-foim  solutions  for  this 


98 


approach  do  not  exist,  and  numerical  methods  attempting  to  solve  the  Navier-Stokes 
partial  differential  equations  in  this  domain  tend  to  introduce  more  unknown 
parameters  than  they  eliminate.  This  is  a  particular  problem  for  UUVs  which  often 
have  irregular  shapes.  Additionally,  CFD  problems  are  among  those  currently 
considered  as  computational  "grand  challenges"  (Draper  94).  Thus  CFD  methods  are 
not  currently  suitable  for  real-time  simulation  of  underwater  vehicle  hydrodynamics. 

Many  models  exi.st  for  ground  vehicles,  air  vehicles,  space  vehicles,  and 
surface  ships  that  appear  suitable  for  real-time  u.se  in  a  virtual  world.  No  complete 
analogous  model  for  underwater  vehicles  was  encountered  during  this  research.  A 
great  many  partial  models  of  underwater  dynamics  exist,  but  all  were  found  to  suffer 
from  incompleteness,  confused  nomenclature,  oversimplification,  or  a  formulation 
unsuitable  fur  real-time  simulation.  No  other  models  were  found  which  combined 
crui.se  mode  hydrodynamics  (propellers,  fins  and  predominantly  forward  velocity)  with 
hovering  mode  hydrodynamics  (thrusters,  station-keeping,  low  forward  motion  and 
large  angle  of  attack).  No  ri^^oroux  general  model  was  previously  available  from  a 
single  source  which  is  computationally  suitable  for  real-time  simulation  of  submerged 
vehicle  hydrodynamics. 

6.  Comparison  Summary 

Examination  of  the  salient  chai'acteristics  of  dynamics  models  in  these 
many  different  robot  environments  reveals  that  the  underwater  case  is  very  difficult  to 
accurately  specify,  most  difficult  to  verify  and  most  critical  for  preventing  catastrophic 
vehicle  loss.  Failure  to  properly  predict  the  dynamics  of  ground  vehicles,  orbital  space 
vehicles  or  surface  ships  at  worst  may  result  in  a  vehicle  which  stays  in  place  and  can 
be  safely  commanded.  Failure  of  aircraft  due  to  improper  prediction  of  aerodynamics 
can  be  mitigated  through  well-developed  analytic  techniques,  wind  tunnel  testing  and 
remote  human  supervisory  control.  Failure  to  properly  predict  the  dynamics  of 
underwater  vehicles  can  lead  to  overall  system  failure  due  to  any  number  of 
subsequent  related  faults  in  control,  sensing,  navigation  or  power  consumption.  This 
critical  vulnerability  in  underwater  vehicle  design  is  a  contributing  cause  to  the  relative 
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rarity  of  working  underwater  robots.  Thus  the  rigorous  and  nearly  complete 
(Healey  93)  hydrodynamics  model,  which  is  compatibly  described  in  (Fossen  94),  has 
been  fully  extended  and  implemented  here.  This  revised  hydrodynamics  model  now 
fills  a  significant  gap  in  the  robotics  and  simulation  literatures. 

C.  COCRDINATE  SYSTEMS  AND  KINEMATIC  EQUATIONS  OF  MOTION 

Proper  definitions  of  coordinate  systems  are  e.ssential  to  specifying  the  physical 
behavior  of  vehicles  in  a  fluid  medium.  There  are  two  coordinate  systems  which  must 
be  understood  independently  and  in  relation  to  each  other:  world  coordinates  and 
body  coordinates. 

World  coordinates  are  defined  with  respect  to  the  surface  of  the  earth,  and  so  are 
sometimes  referred  to  as  earth  coordinates  or  inertial  coordinates.  A  variety  of 
standardized  world  coordinate  systems  are  now  in  common  use.  The  world  coordinate 
system  of  this  model  is  defined  by  three  orthogonal  axes  originating  at  an  ai'bitrary 
local  point  at  the  ocean  surface.  North  corresponds  to  x-axis,  East  corresponds  to 
y-axis  and  increasing  depth  corresponds  to  z-axis  as  shown  in  Figure  6.1.  These  axes 
follow  right-hand  rule  conventions,  and  are  identical  to  (or  compatible  with)  standard 
world  coordinate  systems  defined  in  robotics,  computer  graphics,  aircraft 
aerodynamics,  naval  architecture,  navigation  and  the  Distributed  Interactive 
Simulation  (DIS)  protocol  (Fu  87)  (Foley,  van  Dam  90)  (Cooke  92a,  92b)  (Lewis  88) 
(Fossen  94)  (Maloney  85)  (IEEE  93,  94a,  94b).  Conversions  from  a  topocentric  local 
earth  coordinate  frame  to  geocentric  or  geodetic  coordinate  systems  are  given  in 
(Lin  93).  Other  coordinate  systems  aie  possible  but  remain  undesirable  if  they  do  not 
match  these  important  standardized  conventions. 

Body  coordinates  are  defined  with  respect  to  the  body  of  the  vehicle  of  interest. 
The  three  axes  of  a  vehicle  are  longitudinal  pointing  in  the  nominal  forward  direction 
of  the  vehicle,  lateral  pointing  through  the  right  hand  side  of  the  level  vehicle,  and 
downward  through  the  nominal  bottom  of  the  vehicle.  The  origin  of  body  coordinates 
for  a  submerged  vehicle  is  at  the  half  point  along  the  symmetric  longitudinal  axis. 
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Typically  this  point  is  at  or  near  the  center  of  buoyancy  [CB),  which  is  the  centroid  of 
volumetric  displacement  of  the  submerged  vehicle.  A  related  location  is  the 
center  of  gravity  (CG),  which  is  the  first  moment  centroid  of  vehicle  mass.  Ordinarily 
the  center  of  gravity  of  a  rigid  body  is  the  point  at  which  net  forces  and  moments  are 
assumed  to  be  applied.  The  center  of  gravity  of  a  ship  or  submarine  is  always 
designed  to  be  below  the  center  of  buoyancy  to  ensure  static  vehicle  stability.  The 
torque  due  to  any  vertical  difference  between  the  two  centers  CB  and  CG  is  called  the 
righting  moment.  A  nonzero  righting  moment  results  when  the  centers  of  buoyancy 
and  gravity  are  not  aligned  vertically,  tending  to  bring  the  submerged  vehicle  back  to  a 
neutral  (typically  level)  pitch  and  roll  posture.  Any  submerged  vehicle  that  instead 
has  center  of  gravity  above  center  of  buoyancy  is  inherently  unstable  and  will  tend  to 
invert,  even  under  static  conditions. 
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Underwater  vehicles  often  include  free-flood  spaces  which  can  equalize  with 
ocean  pressure  through  small  openings,  all  while  remaining  essentially  contained  by 
the  hull.  The  water  enclosed  in  these  free-flood  spaces  directly  contributes  both  to 
volumetric  displacement  and  vehicle  mass.  Thus  free-flood  spaces  affect  buoyancy, 
mass,  center  of  buoyancy,  center  of  mass  and  vehicle  hydrodynamics  response.  While 
submerged  these  effects  are  ordinarily  static  and  not  time-varying. 

Interactions  between  a  vehicle  and  the  ocean  environment  are  defined  from  the 
perspective  of  the  vehicle,  i.e.  within  the  body  coordinate  system.  This  is  because  all 
actions  and  reactions  between  vehicle  and  environment  are  dependent  on  the 
orientation,  shape,  velocity  and  acceleration  of  the  vehicle  body,  with  the  sole 
exceptions  of  gravity  and  ocean  current.  The  direction  of  gravity  can  be  sensed  or 
estimated  and  is  thus  directly  usable  within  the  body  coordinate  frame  of  reference. 
Ocean  current  is  reasonably  assumed  to  act  uniformly  over  the  entire  vehicle  body. 
Therefore  all  vehicle-environment  interactici,*  fir.st  be  calculated  from  the 
perspective  of  the  floating  rigid  body  located  inside  a  larger  homogeneously  moving 
ocean  cuirent  frame  of  reference.  Wind  and  surface  wave  action  are  normally 
assumed  to  have  zero  effect  on  submerged  vehicles  (if  they  do  have  an  effect,  then  a 
surface  ship  model  is  likely  more  appropriate).  Conversion  from  body  coordinates  to 
world  coordinates  consists  of  angular  rotations  to  align  body  axes  with  world  axes, 
correction  for  vehicle  positional  translation,  and  then  additinn  of  coordinate 
displacement  due  to  ocean  current  motion. 

Clear  definition  of  coordinate  systems  greatly  contributes  to  understanding  the 
kinematics  equations  of  motica.  In  order  to  reduce  ambiguity,  the  use  of  {x,  y,  z)  axis 
references  are  in  worlcf  coordinates  except  when  explicitly  stated  otherwise.  Booy 
axes  are  referred  to  as  longitudinal,  lateral  and  vertical,  corresponding  to  (x,  y,  z)  body 
coordinates  when  an  algebraic  description  is  necessary.  Strictly  defined  variables  for 
global  coordinate  frame  translations  and  orientation  rotations  appear  in  coordinate 
system  diagram  Figure  6.2.  Body  coordinate  frame  linear  and  angular  velocities 
(u,  V,  w,  p,  q,  r)  are  shown  in  Figure  6.3. 
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The  global  coordinate  frame  Euler  angle  orientation  definitions  of  roll  ((})), 
piteh  (9)  and  yaw  (\|;)  implicitly  require  that  these  rotations  be  performed  in  order. 
Robotics  conventions  usually  specify  physical  order  of  rotations,  while  graphics 
conventions  usually  specify  temporal  order  of  rotations.  Results  are  identical  in  each 
ca.se.  When  converting  from  world  to  body  coordinates  using  physical  order  (as  might 
be  specified  in  a  three-axis  gimbal  system),  the  first  rotation  is  for  yaw  (y)  about  the 
s-axis,  then  pitch  (0)  about  the  first  intermediate  y-axis,  then  roll  (ij))  about  the  second 
intermediate  x-axis.  Figure  6.4  illustrates  these  intermediate  axes  of  rotation 
pertaining  to  Euler  angle  rotation  (adapted  from  IEEE  94a).  When  converting  from 
world  to  body  coordinates  using  temporal  order  (as  is  common  in  computer  graphics), 
the  first  rotation  is  roll  ((]))  about  the  world  reference  x-axis,  followed  by  pitch  (0) 
about  the  world  reference  y-axis,  and  finally  yaw  (t)/)  about  the  world  reference  z-axis. 
Consistency  of  results  using  either  method  can  be  demonstrated  by  examining  the 
mathematical  order  of  the  resulting  rotation  matrices,  which  is  identical  in  each  case. 
Naturally  the  orders  of  rotations  are  reversed  if  converting  from  body  to  world 
coordinate  frame. 

These  Euler  angle  definitions  are  consistent  with  naval  architecture  definitions 
(Lewis  SX).  This  is  an  important  property  since  twelve  different  and  unique  Euler 
angle  coordinate  system  definitions  are  possible  (Fu  87),  while  only  one  Euler  angle 
convention  corresponds  to  naval  architecture  conventions. 
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Une^ 


angular  rotation 

(right-hand  rule  rotations,  in  order) 


z-axis  "  D^th  psi  yj, 

z  coordinate  yaw  Euler  angle 


Figure  6.2.  World  coordinate  sv.stem:  translation  and  rotation  conventions. 

World  x-axis  =  North,  y-axis  =  East,  z-axis  =  Depth.  World-to-body 

Euler  rotations  occur  in  order: 

first  yaw  (\|/),  then  pitch  (0),  then  roll  ((|)). 


Figure  6.3.  Body  coordinate  system:  linear  and  angular  velocity  conventions. 
Note  that  roll  Euler  angle  rate  ^  roll  rate, 
pitch  Euler  angle  rate  ^  pitch  rate,  and 
yaw  Euler  angle  rate  ^  yaw  rate. 
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First  rotate  about  z  by  ijr,  then  rotate  about  y  by  6,  then  rotate  about  x"  by  4> 


Figure  6.4,  Intermediate  rotation  axes  for  Euler  ang; ;  rotations  from 

world  coordinate  liame  to  body  coordinate  frame,  adapted  from 
(IEEE  y4a). 

Normally  Euler  angles  must  be  restricted  from  representing  a  vertical  orientation 
or  else  mathematical  singularities  may  result.  Several  techniques  for  avoiding  Euler 

angle  singularities  in  the  vicinity  of  0  =  ±  7r/2  are  discussed  in  (Cooke  y2a,  92b). 

1  ern,  ted  ranges  of  the  Euler  angles  follow: 

-Tt  <  <j)  i  7t 


-2i  <  e  <  5.  (6.2) 

2  2 

0  i  ijj  <  2tc  (6.3) 

Additionally,  most  underwater  vehicles  must  be  prevented  from  inverting  horizontally 
or  pointing  vertically,  in  order  to  prevent  internal  vehicle  damage  and  unconU'ollable 
maneuvering  instabilities.  These  restrictions  add  a  further  constraint  on  roll  angle  for 
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normal  operating  conditions,  but  that  constraint  will  not  be  applied  in  this  model  in 
order  to  be  able  to  predict  vehicle  motion  under  all  conditions. 

The  order  of  applying  roll,  pitch  and  yaw  matrix  rotations  is  fixed  since  these 
rotations  are  not  commutative.  The  Euler  angle  rotation  matrices  for  converting  from 
body  to  world  coordinates  follow  in  Equation  (6.4)  (Fu  87)  (Cooke  92b).  Due  to 
typographic  errors  in  a  number  of  other  references,  matrix  multiplication  results  are 
also  included  in  Equation  (6.5).  Finally  it  is  essential  to  note  that,  as  will  be  shown, 
body  coordinate  frame  rotational  velocities  p,  q  and  r  are  quite  different  from  the 

world  coordinate  frame  Euler  angle  rotation  rates  <]),  6  and  tjr. 

[R]  =  [/q,.o  m,.,  (6.4) 

cos(t|;)  -sin(tlr)  0  cos(6)  0  sin(0)  10  0 

=  sin(ilr)  cos(4r)  0  0  1  0  0  cos(<j))  -sin(4)) 

0  0  1  -sin(6)  0  cos(6).  0  sin(<l))  cos(4)) 

cos6‘cosi|r  sm(t)'ain6'cost|r  -  cos4>*siutjr  cos())‘sin0‘cost{)  +  sin<t>'smt|r 

[i2]  =  cosO-sinilr  sin <J)' sill 0- sin t|f  +  cost}) ’COS jjr  cos<t)’sin0'sini|i  -  sin4)‘cos4i 

-sin0  sm4)cos0  cos(t>'cos0 

Since  the  body  to  world  rotation  maU’ix  [/i]  is  an  orthogonal  matrix,  it  follows  that 
K  inver.se  equals  [/?]  transpose. 

[R]-^  =  [Rf 
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The  three  world  coordinate  frame  translation  rates  can  be  obtained  from  the  body 
coordinate  frame  translation  rates  by  the  following  matrix  equation; 


X 

u 

y 

=  [R] 

V 

z. 

w 

Inversely,  body  coordinate  frame  velocities  can  be  determined  from  world  coordinate 
frame  velocities  in  a  similar  fashion: 


u 

X 

V 

=  [/J]^ 

y 

w 

i 

(6.8) 


The  three  world  coordinate  tiame  Euler  angle  rotation  rates  are  obtained  from 
body  coordinate  frame  rotation  rates  by  the  following  non-orthogonal  linear 
transformations  (Cooke  y2b): 

<jj  =  p  +  g  sin(<|>)  tan(0)  +  r  cos(<}>)  taii(6) 

0  =  ^co{i(4>)  -  rsin((j)) 

ij;  =  gsin(<t))  rcos(<{)) 
cos(0) 


(6.10) 


(6.11) 
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These  three  eoiiversions  can  be  combined  into  matrix  notation: 


p 

e 

=  [T] 

r 

(6.12) 


where 


[T] 


1  sm(<|))  tan(0)  cos(4))  tan(0) 
0  cos((|))  -sin(<i)) 

0  slii(<t>)  sec(Q)  cos(4>)  sec(0) 


(6.13) 


However  note  that  [7’]  is  not  orthogonal,  so  [7’]"‘  is  not  calculated  by  tiansposition: 


[ri-‘  ^  [TV 


(6.14) 


Instead  inverse  equations  for  obtaining  body  angular  velocities  from  Euler  angle  rates 


are  as  follows; 


p  =  4>  -  4fsiia(0) 


(6.15) 


q  -  ^  cos(4))  +  tjf  siix(<|))  cos(O) 


(6.16) 


r  =  -0  sin(<i))  +  ijr  cos(*)  cos(0) 


(6.17) 


which  yield  tlie  following  matrix  equations: 
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p] 

<i> 

1 

II 

0 

r\ 

(6.18) 


1  0  -sm(0) 

[r]"‘  =  0  cos((t>)  sm((|)) cos(6) 

0  -sin(<|>)  cos(4))  cos(0) 


(6.19) 


Tlic  pi'L'ceding  ecjuutioiis  provide  a  complete  set  of  component  conversions 
between  tlie  world  coordinate  liame  and  body  coordinate  frame  linear  and  angular 
velocides.  All  component  velocities  can  be  further  grouped  together  in  matrix 
notation.  Combined  velocity  matrix  definitions  are  as  follows: 


(6.20) 


(6.21) 
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Matrix  conversion  from  body  to  world  velocities  is  thus: 


and  inversely: 


[^Iworld 


= 


[R] 

1  ^ 

0 

1  [T] 

IJif  1 

0 

0 

[T]-' 

[V] 


world 


(6.22) 


(6.23) 


These  velocity  relationships  are  the  kinematics  equations  of  motion 
(Greenwood  KX).  Rquations  (6.22)  and  (6.23)  are  equivalent  ways  of  expressing  Euler 
angle  constraints  between  the  inertial  \Vorld  coordinate  frame  and  the  rotating  body 
coordinate  frame.  Each  has  six  component  equations  linking  twelve  velocity 
components.  When  combined  with  the  dynamics  equations  of  motion,  the  kinematics 
equations  of  motion  provide  constraints  es.sential  to  solving  world  coordinate  system 
values  of  the  vehicle  state  vector. 

1).  (JliNKRAI.  RKAL-TIME  HYDRODYNAMICS  MODEL  FOR  AN 
UNDERWATER  VEHICLE 

1.  DeHnitiuns' 

A  virtual  world  simulation  component  for  hydrodynamics  modeling  of  a 
submerged  rigid  body  must  account  for  six  spatial  degrees  of  freedom  in  real  time. 

The  six  spatial  degrees  of  freedoirr  include  position  (3  position  coordinates  x,  y,  z)  and 
orientation  (3  rotational  Euler  angles  (j),  Q,  xj/).  Together  these  six  components 
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describe  vehicle  posture  (x,  y,  z.  (j),  6,  \|/).  Accelerations  and  velocities  each  have 
these  same  six  spatial  degrees  of  freedom. 

Six  values  for  velocity  and  six  values  for  posture  comprise  the  vehicle 
state  vector,  since  together  they  can  fully  specify  in  vehicle  posture  over  time  without 
redundancy.  This  state  vector  is  in  the  world  coordinate  .system.  ITie  overall  goal  of 
the  hydrodynamics  model  is  to  calculate  updated  values  of  the  vehicle  state  vector  at 
each  time  step. 

Much  more  information  is  needed  to  describe  robot  state.  The 
hydrodynamics  model  needs  a  reasonably  complete  .snapshot  of  robot  state  in  order  to 
properly  predict  interactions  between  robot  and  envii'onment.  All  hydrodynamics  state 
variables  must  be  included,  as  well  as  a  variety  of  sensor  values,  pertinent  robot  logic 
states,  and  variables  for  accelerations  (due  to  forces  and  moments)  as  produced  by 
effector  values  for  propellers,  rudders,  planes  and  thrusters.  The  dynamics  model  is 
providetl  this  partial  snap.shot.of  current  robot  state  with  each  exchange  of  the  robot 
iclcmeu  y  record.  After  examining  parameters  controlled  by  the  robot  (e.g.  robot 
orders  for  propellers  and  fins),  die  hydrodynamics  model  then  calculates  an  updated 
state  vector.  With  the  updated  state  vector  the  hydrodynamics  model  is  then  able  to 
calculate  values  expected  from  various  robot  sensors  which  ordinaiily  query  the 
environment,  liy  updating  missing  sen.sor  values  in  the  robot  telemeliy  record  with 
newly  calculated  sensor  values,  the  hydrodynamics  model  provides  virtual  sensor 
response  in  the  laboratory.  Vehicle  operation  in  virtual  world  or  real  world  remains 
transparent  to  the  robot,  further  details  on  this  data  communication  mechanism  ai'c 
included  in  Chapter  IV. 

2.  Keal  Time 

"Real  time"  in  this  context  is  defined  by  the  requirement  that  a  vehicle 
maneuvering  within  the  virtual  world  de.scribe  es.sentially  the  same  path  and  postures 
us  the  vehicle  maneuvering  in  the  real  world.  This  requires  that  the  robot  hai'dwai'c 
and  software  receives  the  same  responsiveness  from  the  virtual  world  as  from  tire  real 


world,  since  robot  behavior  is  very  closely  coupled  to  real-time  interactions  and 
deadlines  (Payton  91)  (Badr  92). 


A  real-time  system  is  a  system  that  must  satisfy  explicit  (bounded) 
response-time  constraints  or  risk  severe  consequences,  including  failure... 

A  faik’d  system  is  a  system  which  cannot  sati.sfy  one  or  more  of  the 
requirements  laid  out  in  the  formal  system  specification.  (Laplante  93) 

Real-time  systems  can  be  further  characterized  by  the  criticality  of  their 
timing  requirements,  which  are  classified  as  hard  or  soft.  Hard  real-time  system 
correctness  is  strictly  dependent  on  the  timeliness  of  results.  Soft  real-time  systems 
may  experience  reduced  effectiveness  but  will  not  fail  due  to  missed  deadlines. 
Alternatively,  hard  real-time  systems  are  those  which  include  the  possibility  of  system 
loss  or  potential  catastrophe  if  deadlines  ai'e  not  met,  and  soft  real-time  systems  are 
those  where  er  is  better  than  later"  but  lateness  will  not  cause  sy.stem  failure.  As 
a  point  <.9’  i'Mcrest,  y?rm  real-time  systems  have  been  defined  as  those  widi  hard 
deadlines  that  can  survive  despite  the  presence  of  low  probabilities  for  ntis-sing  a 
deadline.  (Laplante  93)  (Halang  91) 

By  these  definitions  it  is  clear  that  the  system  consisting  of  a  robot 
interacting  with  a  dynamics-based  virtual  world  is  a  hard  real-time  system. 

Furthermore  the  robot  itself  operating  in  a  real  world  environment  is  also  a  hai'd 
real-time  system,  since  a  temporal  failure  in  navigation  or  depth  control  might  result  in 
vehicle  destruction.  However,  in  isolation,  the  dynamics  component  of  the  virtual 
world  are  able  to  provide  accurate  results  regardless  of  the  temporal  scaling  of 
interaction  requests.  Therefore  the  dynamics  model  per  se  can  be  classified  as  a  soft 
real-time  system.  It  only  needs  to  be  fa.st  enough  to  support  the  hard  real-time 
requirements  of  the  networked  robot  processors.  In  general,  hydrodynamics  model 
responsiveness  will  be  a  function  of  algorithmic  complexity,  implementation 
efficiency,  microprocessor  performance  and  communications  latency. 
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3.  Forces,  Moments  and  Accelerations 

Forces  and  accelerations  for  the  six  state  variables  of  posture  can  be 
grouped  together  in  the  matrix  form  of  Newton’s  Second  Law,  initially  expressed  as 

For  a  rigid  body,  translational  forces  are  normally  applied  at  the  CG.  Moments  are 
free  vectors  producing  rotations  to  be  applied  about  the  origin  of  the  vehicle  body, 
since  inertial  integrals  are  calculated  relative  to  that  origin.  Usual  practice  is  to  define 
CG  measurements  as  being  offset  from  CB.  Vehicle  origiti  is  not  assumed  coincident. 
The  key  to  properly  estimating  world  coordinate  frame  velocities  and  position 
will  be  properly  calculating  time  rate  of  change  of  velocities  in  the  body  coordin  : 
frame,  represented  as: 


Time  rate  of  change  of  body  velocities  can  also  be  referred  to  as  body-relative 

accelerations  However  it  must  be  cleaidy  understood  that  these  body 

accelerations  are  only  with  respect  to  the  body  coordinate  frame,  i.e.  those  which 
appear  to  a  local  observer  moving  with  the  body  reference  frame  (Greenwood  88). 
Absolute  acceleration  components  due  to  rotation  and  velocity  changes  between  the 
body  reference  frame  and  world  reference  frame  are  specifically  excluded 

from 
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Since  physical  interactions  occur  between  the  vehicle  and  the  immediately 
surrounding  water  volume,  force  and  moment  calculations  are  most  directly  evaluated 
in  the  body-fixed  coordinate  frame.  Moment  of  inertia  terms  in  the  mass  matrix  [M] 
can  only  be  constant  in  a  body  coordinate  frame,  further  making  the  body  frame 
attractive  for  dynamics  calculations.  Mathematical  rederivation  of  known  acceleration 
relationships  in  a  world  coordinate  reference  frame  is  possible  using  a  Lagrangian 
representation  (Fossen  94).  However  such  a  form  appears  to  be  much  less  direct  than 
the  Newton-Euler  formulations,  paiticularly  since  the  virtual  world  is  centered  around 
a  robot  vehicle  which  operates  and  interacts  relative  to  the  local  body-fixed  coordinate 
frame.  Therefore  it  is  desirable  that  all  linear  and  angular  acceleration  and  velocity 
relationships  be  specified  exactly  and  completely  in  the  body  coordinate  frame.  Doing 
so  yields  six  dynamics  equations  of  motion  relating  the  twelve  unknowns  of  the 
vehicle  state  vector  derivatives:  six  unknowns  are  body  velocities,  and  six  unknowns 
aie  body  accelerations. 

Although  the  vector  sum  of  velocity  components  expressed  in  body 
coordinates  equals  the  vector  sum  of  velocity  components  expressed  in  world 
coordinates,  an  equivalent  relationship  does  not  hold  for  body  and  world  acceleration 
vectors  because  the  body  coordinate  frame  is  rotating.  Specifically,  differentiating 
Equation  (.6.22)  with  respect  to  time  yields; 


dt 


[i«] 
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d  (6.26) 
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Substituting  acceleration  [A]  for  time  rate  of  change  of  [V^l  (as  always  in  the 
appropriate  coordinate  frames)  results  in 


[^] 


\vorld 
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[T] 


[R] 


0 


0 


[r] 


(6.27) 


Inspection  of  Equation  (6.27)  makes  it  clear  that  world  coordinate  frame 
accelerations  and  rotated  body  coordinate  frame  accelerations  ai'e  not 

equivalent  unless  the  transformation  matrix  between  coordinate  frames  is  unchanging, 
or  all  body  velocities  are  zero  (Greenwood  88).  It  is  possible  to  examine  accelerations 
acting  upon  the  body  from  a  perspective  within  the  rotating  body  coordinate  frame,  but 
they  cannot  be  directly  integrated  into  world  coordinate  frame  accelerations. 

It  is  possible  to  numerically  integrate  the  six  dynamics  equations  with 
respect  to  time  and  determine  new  velocity  values.  This  dynamics  equation  integration 
must  be  performed  using  body  coordinate  frame  variables.  Once  new  values  for  body 
velocities  are  thereby  obtained,  the  six  Euler  kinematic  constraint  equations  of  motion 
(6.22)  are  utilized  to  produce  linear  and  angular  world  velocities.  Finally  posture  is 
determined  within  the  world  coordinate  system  using  world  velocities. 

4.  Time  Dependencies 

During  operation  of  a  vehicle  in  a  virtual  world,  forces  acting  on  the  robot 
can  be  estimated  from  the  vehicle  state  vector  while  velocities  and  body  accelerations 
are  analytically  derived.  During  operation  in  the  real  world,  forces  can  be  similarly 
esilinated  while  accurate  velocity  and  body  acceleration  information  may  (or  may  not) 
be  available  from  flow  and  inertial  navigation  sensors.  In  either  world,  good  estimates 
of  changes  in  body  frame  velocities  are  a  primary  robot  requirement  so  that  velocity 
and  posture  estimates  can  be  cumulatively  integrated  over  time.  Accurately  estimating 
body  frame  velocity  changes  at  suitably  short  time  intervals  is  the  key  to  properly 
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modeling  vehicle  hydrodynamics  response.  Thus  the  dynamics  equations  of  motion 
must  be  written  to  produce  time  rates  of  change  of  velocities  as  the  dependent 
variables,  obtained  through  calculations  that  solely  im  olve  vehicle  variables  (such  as 
posture,  propellers,  thrusters  and  plane  surfaces)  which  are  continuously  known  to  the 
robot. 

The  Newton-Euler  formulation  of  Newton’s  Second  Law  from 
Equation  (6.24)  can  be  expanded  by  the  chain  rule  to  produce 


dt 


\ 


ibody 


^  d\M] 

dt 


[V]  .  [M] 


dt 


(6.28) 


Within  the  body  coordinate  frame  the  mass  matrix  [M]  is  unchanging. 
Differentiation  of  the  velocity  matrix  [V]  reveals  effects  that  are  due  to  the  body 
coordinate  frame  rotating  with  angular  velocity  o)  with  respect  to  the  world  coordinate 
frame  (Fossen  94): 


Since  matrix  multiplication  is  associative  but  not  commutative,  both  sides 
of  matrix  Equation  (6.29)  can  be  multiplied  by  a  single  matrix  as  long  as  order  of 
multiplication  is  carefully  preserved.  In  this  case  both  sides  of  Equation  (6.29)  are 
multiplied  by  the  mass  matrix  inverse  [Af]"'.  Transposing  the  result  yields 
Equation  (6.3U); 

•  ’  ["]■'  •  ['=']».«  -  “ xiK]^  <«-30) 

This  form  of  the  dynamics  equation  is  very  important  from  a 
time-integration  perspective,  since  all  accelerations  are  grouped  together  on  the 
left-hand  side.  All  terms  on  the  right-hand  5,ides  of  the  dynamics  equations  are  known 
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or  can  be  determined  during  vehicle  operation  in  the  virtual  world.  Thus  calculation 
oi  the  right-hand  side  can  be  used  to  determine  updated  values  of  the  left-hand  side. 

Minimizing  errors  during  the  integration  time  step  is  essential  for  accurate 
real-time  simulation  of  hydrodynamics  models.  This  is  due  to  the  sensitivity  of  the 
hydrodynamics  model  to  small  perturbations,  as  well  as  the  high  degree  of 
cross-coupling  between  forces  acting  on  the  three  physical  body  axes  of  an  submerged 
vehicle.  If  errors  in  determining  body  accelerations  are  minimized,  then  integration  of 
body  accelerations  and  subsequent  coordinate  frame  ti'ansformations  to  yield  velocities, 
positions  and  orientations  will  also  minimize  any  accumulated  errors  inherent  in 
velocity  and  po.sture  estimation. 

The  local  forces  acting  on  an  autonomous  underwater  vehicle  are  due  to 
onboard  effectors  such  as  propellers,  thrusters,  planes  and  rudders.  External  ocean 
current  forces  are  assumed  to  vary  slowly  with  respect  to  vehicle  time  and  act  on  the 
entire  vehicle  uniformly,  having  no  effect  on  the  interactions  between  the  vehicle  and 
the  immediately  adjacent  water  volume.  Ocean  cuitent  effects  can  therefore  be  added 
as  a  simple  uniforn.  ti'anslation.  This  vector  addition  is  performed  after  fully 
calculating  the  effects  of  body  accelerations  and  velocities,  and  after  shifting  back 
from  a  body  cocrdinalr  s/,kTm  to  the  world  coordinate  system,  Thus  all  forces  can  be 
completely  determined  or  estimated  in  real  time  during  vehicle  operation.  For 
constant-ballast  vehicles,  all  elements  of  the  body  frame  mass  matrix  [M]  and 
corresponding  inverse  [M]  ‘  can  be  determined  empirically  through  prior  testing  (to  a 
close  first  approximation)  and  ai'e  not  time-varying. 

5.  Velocities  and  Postures 

Combination  of  force  and  mass  matrices  as  described  above  gives  a  very 
accurate  estimation  of  time  rates  of  change  of  body  velocities.  The  body  velocity  rate 
matrix  is  integrated  first  to  provide  linear  and  rotational  velocities,  then  integrated 
again  to  provide  po.sture.  Initial  integration  to  yield  body  velocities  occurs  in  the  body 
fixed  coordinate  frame: 
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(6.31) 


(rO+8f)  “  f-^^body(iO) 

Integration  of  the  new  body  velocities  to  determine  posture  is  preceded  by  a 
transformation  from  the  body-fixed  coordinate  frame  to  the  world  coordinate  frame. 
The  following  substitution  pertains: 


(6.32) 


The  final  integration  to  determine  posture  is  therefore: 

ra*St 

[  Posture  j,o  ^  ^  W  ^ 

rto<-6t  (6.33) 

+  [Ocean  currents] dt 

6.  Deriving  Desired  Form  of  Dynamics  Equations  of  Motion 

A  full  set  of  hydrodynamic  equations  of  motion  for  a  submerged  vehicle 
are  not  usually  written  in  the  form  suggested  by  Equations  (6.30),  (6.31),  (6.32)  and 
(6.33).  Other  derivations  have  been  pre.sented  in  the  ooen  literature  (Gertler  76) 
(Smith  79)  (Feldman  79)  (Papoulias  89)  (Watkinson  89)  (Yuh  90)  (Humplrreys  91) 
(Baiardi  92)  (Healey  93)  (Fossen  94)  and  a  variety  of  other  sources,  but  are  structured 
in  such  a  way  that  similar  time-dependent  acceleration-related  terms  are  present  on 
both  sides  of  the  dynamics  equations  of  motion.  Because  related  body  acceleration 
terms  are  not  grouped  together,  direct  time  integration  of  both  sides  of  the  equations 
of  motion  is  not  mathematically  valid  in  those  representations.  Furthermore  these 
many  references  are  all  handicapped  by  variations  in  nomenclature  and  even  a 
surprising  variety  of  typographical  errors,  mathematical  errors  or  omissions.  None  of 
these  other  models  cun  be  duectly  applied  as  a  vahd  real-time  underwater  virtual 
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world  component.  Therefore  the  primary  intended  contributions  of  the  hydrodynamic 
model  developed  here  are  clarity,  correctness,  aeneraliiy,  standardized  nomenclature 
and  suitability  for  real-time  simulation. 

Given  this  broad  outline  showing  how  the  dynamics  equations  of  motion 
will  be  utilized,  it  is  time  to  derive  the  desired  forms  of  the  hydrodynamics  equations. 
We  cun  reorganize  all  of  the  original  (Healey  93)  equations  of  motion  to  solely  have 

muss-related,  inertia-related  and  [ru  -related  terms  on  the  left-hand  side.  That 


rearrangement  leaves  lift  and  drag,  buoyancy,  weight,  propulsion  thrust,  and  other 
forces  and  moments  on  the  right-hand  side.  At  any  given  in.stant 
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Calculating  the  inverse  mass  matrix  and  multiplying  it  against  both  sides  of 
Equation  (6.34)  leaves  only  body  accelerations  on  the  left-hand  side.  Further 
classification  of  individual  terms  on  the  right-hand  side  as  corresponding  to  Coriolis, 
centripetal  and  other  forces  can  be  found  in  (Greenwood  88)  (Healey  y2c).  For  the 
purpose  of  this  derivation  it  is  sufficient  to  group  the.se  accelerations  together  without 
further  discussion.  Such  an  arrangement  prepares  the  dynamics  equations  of  motion 
for  temporal  integration  in  the  body-fixed  coordinate  frame  as  follows: 
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The  body  tiame  velocity  matrix  can  now  be  updated  by  numerical 
integration.  For  example,  Buler  integration  (Hamming  Xb)  (Green  91)  (ITess  92) 
yields: 
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(6.36) 


A  slightly  more  precise  estimation  of  the  velocity  maU-ix  can  be  achieved 
by  averaging  body  acceleration  at  the  beginning  and  end  of  each  time  step  prior  to 
integrating  with  respect  to  time.  This  method  called  second-order  Runge-Kutta  or 
Heun  integration  (Fossen  94),  and  is  also  the  approach  used  for  velocity  estimation  in 
the  source  code  implementing  this  work  (Brutzman  94e). 
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(6.37) 


where  [uvwpq  r] 


ill  Liquation  (6.37)  is  itself  an  estimate  obtained  by  Euler 


iiUet-ration  of  [uvwpq  f]J), 

Conversion  of  these  body  velocities  to  world  velocities  is  performed  using 
the  uansfoniiation  of  Equation  (6.22).  Sub.sequent  integration  of  world  velocities  into 
world  iiosture  is  performed  by  Euler  integration  us  follows; 


(6.3K) 


Final  addition  of  ocean  current  effects  completes  the  calculation  of  world  coordinate 
system  posture,  as  previously  specified  in  Equation  (6.33). 

Increasingly  accurate  temiwral  re.solution  is  possible  using  .smaller  time 
steps,  chosen  adaptively  if  necessary.  Further  numerical  analysis  considerations  and 
recommendations  appear  in  (Press  92)  (Green  91)  and  (Hamming  86).  In  practice,  a 
fixed  time  step  of  0. 1  .seconds  has  worked  well  for  model  resolution,  real-time  robot 
hardware  control  response,  network  latency,  remote  interaction,  computer  graphics 


reiidei'iiig  updatt^  rate,  and  liumaii  observation.  Caie  must  be  taken  if  higher-order 
integration  methods  are  employed  to  ensure  that  hydrodynamics  model  responsiveness 
does  not  degrade  past  the  real-time  requirements  of  the  robot  operating  in  the  virtual 
u.orld. 

To  summarize:  the  dynamics  equations  of  motion  aie  not  mathematically 
rewritten  in  world  coordinates,  but  are  kept  in  body  coordinates.  Integrating  the 
dynamics  equations  of  motion  provides  body  velocity  values  at  the  next  time  step. 
The.se  new  body  coordinate  frame  velocities  are  combined  with  the  kinematics 
equations  of  motion  to  produce  world  coordinate  frame  velocities.  World  velocities 
are  then  integrated  and  added  to  ocean  current  effects  to  produce  updated  world 
postures.  Algorithmic  complexity  is  sufficiently  low  to  permit  rapid  model  respon.se 
within  the  same  time  period  that  the  robot  normally  u.ses  to  query  vehicle  sen.sors. 

7.  Nuiiieiicluture  I'ubles  for  Vuriubles  and  Coutlicient.s 

The  many  details  pertaining  this  approach  still  need  to  he  filled  in  using  a 
complete  six-degree-of-freedom  .set  of  dynamics  equations  of  motion.  First,  however, 
it  must  be  noted  that  small  yet  per.Mstent  nomenclature  mconsistencies  were 
encountered  in  all  of  the  dozens  of  hydrodynamics  references  studied,  litis  is  a 
serious  problem  for  newcomers  to  the  hydrodynamics  literature,  since  both  names  and 
definitions  of  key  terms  may  vary,  litis  lack  of  .standardization  results  in  troublhtg 
matheittatical  incompatibilities  throughout  an  entire  body  of  .scientific  literature. 

Clearly  an  iiviportant  itrerequisite  for  de.scribing  any  general  hydrodynamics  model  is 
to  u.se  well-defined  (and  hopefully  standardized)  iioinenclature.  Of  all  the 
hydrodynamics  models  studied  in  this  work.  (Healey  93)  and  (Fossen  94)  appear  to  be 
die  most  general  and  most  applicable  for  real-time  simulation  of  autonomous 
underwater  vehicle  response.  I'lte  nomenclature  of  (Healey  93)  closely  follows  thut  of 
the  standard  reference  work  on  ship  control  (Lewis  88).  Hie  same  nomenclature  is 
followed  here. 

Since  usage  of  a  rigorously  standardized  nomenclature  is  only  partially 
possible,  this  work  will  attempt  to  follow  accepted  eonventions  wherever  po.ssible 
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while  precisely  defining  all  variables  and  coefficients,  both  mathematically  and 
descriptively,  roefficient  subscripts  from  previous  models  have  been  coitected  when 
necessary  to  explicitly  indicate  accompanying  variable  factors.  Such  an  approach 
permits  comparison  of  this  hydrodynamics  model  with  any  other  work,  and  hopefully 
provides  clarity  in  a  subject  ai'ea  that  unfortunately  includes  wide  valuation. 

The  following  tables  define  and  de.scribe  the  state  variables  and 
hydrodynamics  coefficients  used.  Symbol,  name,  description,  units  and  coefficient 
value  (for  the  NFS  AUV)  ai'e  included.  Vai'iable  and  coefficient  names  in 
implementation  .software  .source  code  (Brutzman  y4c)  match  exactly  to  further 
encourage  clarity  and  correctness. 

Close  examination  of  the  dynamics  equations  of  motion  reveals  that  near  ly 
all  of  the  hydrodynamics  coefficients  are  dimensionless,  having  been  normalized  with 
respect  to  vehicle  length  L.  This  convention  permits  rough  comparison  of  the  relative 
effects  of  individual  coefficients  with  other  vehicles  or  between  different  body  axis 
orientations. 

Coefficienis  presented  here  have  been  tested  for  a  large  variety  of 
scenarios  (Brutzman  y4e).  Neverthele.ss  the  complexities  of  hydrodynamics  testing 
and  intricacies  of  this  model  preclude  complete  validation,  verification  aird 
accreditation.  Constant  coefficients  are  included  fur  dynanrics  effects  that  occur  in 
both  crui.se  nrode  and  hover  mode.  For  vehicles  that  are  capable  of  much  higher 
speeds,  coefficients  are  expected  to  become  variable  as  a  function  of  Reynolds 
Number,  which  quantifies  the  transition  from  laminar'  to  fully  developed  turbulent  fluid 
flow.  Fxaminatiun  of  Reynolds  nunrber  effects  on  hydrodynamics  coefficients  appears 
in  (Humphreys  89)  (Roth,  Humphreys  90)  (Humphreys  91).  Further  te.sting  and 
refinement  of  hydrodynamics  coefficients  for  various  vehicles  is  an  important  subject 
for  future  work. 

Although  lengthy,  proper  definition  of  the  numerous  state  var  iables  and 
hydrodynamics  coefficieirts  is  essential  when  pi'oducing  and  understanding  a 
liydrodynamic  model  capable  of  providing  precise  response  within  an  underwater 
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virtual  world.  The  complete  tables  are  pre.scnted  here  as  an  integral  and  essential  part 
of  the  hydrodynantics  model,  in  order  to  provide  context  for  the  derivations  of  the 
equations  of  motion  which  laDllow.  A  similaidy  exhaustive  set  of  definitions  for 
submarine  simulation  is  included  in  (Feldman  79),  NFS  AUV  11  coefficient  values  are 
Irom  (Warner  91 )  (Bahrke  92)  (Mai'co  95)  and  laboratory  testing.  All  angular 
definiliuiis  conform  to  the  right-hand  rule.  Readers  interested  in  comprehending  the 
final  six  dynamics  equations  of  motion  are  urged  to  clo.sely  examine  the  precise 
variable  and  coefficient  definitions  provided  in  these  nomenclature  tables. 


124 


Table  6.1.  Hydrodynamics  and  Control  System  Variables. 


Nairn; 

DuNcriptlon 

Cooi'dlnutu 

.sy.stc'in 

Unit.s 

m^i 

time 

Cluck  lime  (real  or  simulated) 

- 

seconds 

6/ 

tiinc  step 

Loop  interval  (robot  or  dynamics  model) 

- 

seconds 

X 

X 

Position  along  Nortli-South  axis. 

North  positive, 

world 

feet 

y 

y 

Position  along  East-West  axis, 

Bast  positive. 

world 

I'cet 

L 

Depth,  downward  direction  is  positive. 

w'orld 

feet 

0 

roll  liulor 

angle 

Roll  Buler  angle  rotation  about 

North-South  axis,  preceding  pitch  and 

yaw  rotations.  Positive  .sen.se  clockwi.se 

as  seen  from  stern  to  bow  of  vehicle. 

world 

radians 

0 

pitch 

liuler 

angle 

Pitch  Buler  angle  rotation  about 

Bast-West  axis,  following  rotation  for 

roll  and  preceding  rotation  for  yaw. 

Positive  sen.se  is  clockwise  as  seen  from 

port  side  of  vehicle. 

world 

radians 

yaw 

Euler 

angle 

Yaw  Buler  angle  rotation  about  vertical 

(depth)  axis,  following  rotations  for  roll 

and  pitch.  Positive  sense  is  clockwise  as 

seen  from  above, 

world 

radians 
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Syiiibi)! 

Nanio 

Duscription 

Cuordinute 

-system 

Units 

X 

\  dot 

Linear  velocity  along  North-South  axis. 

world 

ft/sec 

n 

y  dot 

Linear  velocity  along  East-West  axis. 

world 

ft/sec 

i 

z  dot 

Linear  velocity  along  Depth  axis. 

world 

ft/.sec 

phi  dot 

Roll  Euler  angle  rate  component,  about 

North-South  axis.  Not  equivalent  to  p. 

world 

radians/sec 

e 

theta  dot 

Pitch  Euler  angle  rate  component,  about 

East-West  axis.  Not  equivalent  to  q. 

world 

radians/sec 

'i' 

psi  dot 

Yaw  Euler  angle  rate  component,  about 

vertical  (depth)  axis.  Not  equivalent  to  r. 

world 

radians/sec 

u 

surge 

Linear  velocity  along  longitudinal  axi.s. 

body 

I’t/sec 

V 

sway 

(sidcslii)) 

Linear  velocity  along  lateral  axis. 

body 

IVscc 

m 

heave 

Linear  velocity  along  vertical  axis. 

body 

IQBI 

p 

roll  rate 

Angular  velocity  component  about 

longitudinal  axi.s.  Not  equivalent  to  <j) . 

body 

radians/sec 

<1 

pitch  rate 

Angular  velocity  component  about 

lateral  axis.  Not  equivalent  to  0 . 

body 

radians/sec 

r 

yaw  rate 

Angular  velocity  component  about 

vertical  axis.  Not  equivalent  to  tjf . 

body 

radians/sec 

I 
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Symbol 


Name 

Description 

u  dot 

Time  rate  of  change  of  surge  velocity 

(along  longitudinal  axis) 

V  dot 

Time  rate  of  change  of  sway  velocity 

(along  lateral  axis) 

w  dot 

Time  rate  of  change  of  heave  velocity 

(along  vertical  axis) 

p  dot 

Tiitte  rate  of  change  of  roll  angular 

velocity  (about  longitudinal  axis) 

q  dot 

Time  rate  of  change  of  pitch  angular 

velocity  (about  lateral  axis) 

r  dot 

Time  rate  of  change  of  yaw  angular 

velocity  (about  vertical  axis) 

bow 

rudders 

angle 

Bow  rudder  deflection  angle.  Usually 

bow  and  stern  rudders  orders  go  to 

exactly  opposite  positions.  Positive 

sense  is  clockwise  as  seen  from  above. 

Positive  bow  rudders  angle  with  positive 

surge  u  produces  positive  change  in  yaw. 

Coordinate 

system 


Units 


ft/sec" 
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Coordinate 


Symbol  Name  Description  system  Units 


Stern 

rudders 

angle 

Stern  rudder  deflection  angle.  Usually 

bow  and  stern  rudders  go  to  exactly 

opposite  positions).  Positive  sense  is 

clockwise  as  seen  from  above.  Positive 

stern  rudders  angle  with  positive  surge  u 

produces  negative  change  in  yaw. 

body 

radians 

bow 

planes 

angle 

Bow  planes  deflection  angle.  Usually 

bow  and  stern  planes  go  to  exactly 

opposite  positions).  Positive  sense  is 

clockwise  as  seen  from  the  port  side  of 

the  vehicle,  Positive  bow  planes  angle 

with  positive  surge  u  produces  positive 

change  in  pitch. 

body 

radians 

stern 

planes 

angle 

Stern  planes  deflection  angle.  Usually 

bow  and  stern  planeS  go  to  exactly 

opposite  positions).  Positive  sense  is 

clockwise  as  seen  from  the  port  side  of 

the  vehicle.  Positive  stern  planes  angle 

with  positive  surge  u  produces  negative 

change  in  pitch. 

body 

radians 

^porT 

Port  rpm 

Port  propeller  ordered  turns 

body 

rpm 

Stbd  rpm 

Starboard  propeller  ordered  turns 

body 

rpm 
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Syml)i)l 

Name 

Description 

Coordinate 

sviteiii 

Units 

1/ 

hoH‘^\'i'riical 

Volts,  bow  vertical  cross-body  thruster 

(±24  V  corresponds  to  ±2.0  lb) 

body 

volts 

V 

sU'rH'Vi'rxical 

Volts,  stern  vertical  cross-body  thruster 

(±24  V  corresponds  to  ±2.0  lb) 

body 

volts 

y 

^  hoH  -iaJvriil 

Volts,  bow  lateral  cros.s-body  thruster 

(±24  V  corresponds  to  ±2.0  lb) 

body 

volts 

V 

iUrn-Uaerat 

Volts,  stern  lateral  cros.s-body  thruster 

(±24  V  corresponds  to  ±2.0  lb) 

body 

volts 
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Table  6.2.  Hydrodynamics  Model  Coefficients. 


Name 

Description 

Value  for 

NPS  AUV  II 

W 

weight 

Submerged  weight  of  vehicle,  including  water 

in  contained  free-flood  spaces,  neutral  ballast. 

435  lb 

B 

buoyancy 

Weight  of  water  displaced  by  vehicle,  including 

water  in  contained  free-flood  spaces. 

Can  vtrry  with  depth  (due  to  hull  compression) 

and  with  changes  in  water  density  p. 

435  lb 

L 

length 

Vehicle  length,  also  known  as  characteristic 

length.  Dynamics  equations  of  motion  are 

written  to  explicitly  utilize  L  as  a  normalization 

coefficient.  This  approach  makes  most  other 

coefficients  dimensionless  and  quantitatively 

independent  of  vehicle  dimensions,  permitting 

comparison  of  relative  effects  between  different 

forces  and  dissimilar  vehicles. 

7.302  ft 

8 

Acceleration  due  to  gravity 

32.174  ft/sec' 

P 

rho 

Mass  density  of  fresh  water; 

Mass  density  of  sea  water  (representative): 

1.94  slugs/ft' 
1.99  slugs/ft^ 

m 

mass 

Vehicle  mass,  including  water  contained  in 

enclosed  free-flood  spaces,  neutral  ballast. 

W  !  gr--  13.52 

(lb’  secVft 

Mass  moment  of  inertia  coefficient  about  body 

longitudinal  axis.  Equation  (6.55) 

2.7  fflb-  sec‘ 
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CoetTicient  Name  Description 


Value  for 
NFS  AUV  II 


Mass  moment  of  inertia  coefficient  about  body 
lateral  axis,  Equation  (6.56) 


Mass  moment  of  inertia  coefficient  about  body 
vertical  axis.  Equation  (6.57) 


Cross  product  of  inertia  coefficient,  due  to 
asymmetric  mass  distribution  about  body 
longitudinal/lateral  axes,  Equation  (6.58) 


Cross  product  of  inertia  coefficient,  due  to 
asymmetric  mass  distribution  about  body 
longitudinal/vertical  axes,  Equation  (6.59) 


Cross  product  of  inertia  coefficient,  due  to 
asymmetric  mass  distribution  about  body 
lateral/vcrtical  axes,  Equation  (6.60) 


enter  of  Mass  centroid  of  vehicle.  The  CG  is  the 
gravity  apparent  point  where  forces  and  moments  are 
applied. 


Center  of  gravity  location  along  body 
longitudinal  axis,  measured  in  body  coordinates 
from  nominal  vehicle  centroid 


Center  of  gravity  location  along  body  lateral 
axis,  measured  in  body  coordinates  from 
nominal  vehicle  centroid 


42.0  ftib'sec" 


45.0  ft'lb*sec“ 


0.0  ft'lb'  .sec" 


0.0  ft -lb-  sec^ 


0.0  ft -lb-  sec^ 


iX(i,  d'o’.  Za) 


0.125  in 
-  0.010  ft 


3 


buoyancy 


^sitrn-virtlcal 


Description 

Value  for 

NI’S  AUV  11 

Center  of  gravity  location  along  body  vertical 

axis,  measured  in  body  coordinates  from 

nominal  vehicle  centroid.  Note  z,;  is  below 

center  of  buoyancy  by  design  for  passive 

roll/pitch  stability. 

1.07  in 

=  0.089  ft 

Voir  nciric  centroid  of  the  vehicle. 

{Xb,  yu,  Zb) 

Center  of  buoyancy  location  along  body 

longitudinal  axis 

0.125  in 

=  U.OlO  ft 

Center  of  buoyancy  location  along  body  lateral 

axis 

0.0  ft 

Center  of  buoyancy  location  along  body  vertical 

axis.  Note  is  above  center  of  gravity  z,;  by 

design  for  pa.ssive  roll/pitch  stability. 

0.0  ft 

Distance  from  nominal  vehicle  cenU'oid  to 

centerline  of  bow  vertical  thru.ster  tunnel  along 

body  longitudinal  axis. 

1.41  ft 

Distance  from  nominal  vehicle  centroid  to 

centerline  of  stern  vertical  thruster  tunnel  along 

body  longitudinal  axis.  Note  negative. 

-  1.41  ft 

Distance  from  nominal  vehicle  centroid  to 

centerline  of  bow  lateral  thiuster  tunnel  along 

body  longitudinal  axis. 

1.92  ft 
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Cnetficienl 


Name 


Description 


Value  fur 
NPS  AUV  II 


'Vv/fr/i 

Imurui 

Distance  from  nominal  vehicle  centioid  to 

centerline  of  stern  lateral  thruster  tunnel  along 

body  longitudinal  axis.  Note  negative, 

-  1.92  ft 

y  pori-iiroiu'llvr 

Port  propeller  shaft  offset  from 

longitudinal  centerline  of  vehicle 

-  3.75  in 

=  -  0.313  ft 

y  sthJ-prolh'IU'r 

Starboard  propeller  shaft  offset  from 

longitudinal  centerline  of  vehicle 

3.75  in 

=  0.313  ft 

h  f.vj 

Width  of  vehicle  at  body  center  along  the 

y-uxis,  at  a  given  position  x  measured  on  the 

longitudinal  body  axis 

vehicle 

geometry 

tabular  data 

b  (X) 

Height  of  vehicle  at  body  center  along  the 

z-axis,  at  a  given  position  x  measured  on  the 

longitudinal  body  axis 

vehicle 

geometry 

tabular  data 

V,,(x) 

Total  cross-flow  velocity  across  body  at  a  given 

body  position  x  along  longitudinal  axis 

see 

Equation  (6.47) 
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('outncitnt 

Name 

Description 

Value  for 

NFS  AUV  11 

Surge  force  coefficients 

steady-state  spaed 

per  maximum 

propeller  rpm 

Average  forward  velocity  bused  on  combined 

propeller  revolutions  per  minute  (rpm), 

typically  measured  at  maximum  steady-state 

speed.  Analogous  to  turn.s-per-knot  (TPK)  ratio 

for  ships  with  fixed-pitch  propellers. 

'  2  fl/sec  'l 
\700  rpmj 

for  twin 

propellers, 

steady  state 

V 

^  prop 

No  longer  used,  since  term  is  not  a  U'ue 

coefficient.  is  now  decomposed  in 

Equation  (6.43)  to  explicitly  show  individual 

conU'ibuting  propulsion-related  variables,  which 

are  then  included  in  the  revised  surge 

equation  of  motion  (6.48). 

Not  used. 

Previous  values 

ai'e  no  longer 

applicable. 
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('out't'iciunt 

Naniu 

Description 

Value  tor 

NFS  AUV  11 

Coefficients  describing  surge  forces  from 

resolved  lift,  drag  and  fluid  inertia  along  body 

longitudinal  axis.  These  occur  in  respon.se  to 

individual  (or  multiple)  velocity,  acceleration 

and  plane  surface  components,  as  indicated  by 

the  corresponding  subscripts. 

For  example: 

-2.82  E-3 

().() 

4 

O.U 

n 

0.0 

n 

().() 

().() 

O.U 

describes  the  drag  euntribution 

0,0 

in  the  longitudinal  X  direction 

0.0 

due  to  time  rate  of  change  of 

0.0 

surge  velocity  (u) 

0.0 

n 

Note  that  any  coefficient  may  be  non- zero, 

0.0 

1 

^lujBb 

depending  principally  on  the  geomeUy  of  the 

0.0 

BH 

vehicle  being  modeled. 

0.0 

0,0 

Kvtr 

0,0 

X 

^uwob 

• 

0.0 

_ 

0.0 
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^u\u\tbtb 


Drag  force  due  to  square  of  deflection  angle  of 
bow  planes  (8^/,).  stern  planes  and  rudders 
(6,/„  5„)  respectively  due  to  square  of  surge  u 


fluid  inertia  force  due  to  paired  interactions  as 
indicated  by  subscripted  velocities,  typically 
nonzero  only  as  a  result  of  asymmetries  in  the 
vehicle  hull  form 


-1.018  E-2 


-1,018  E-2 


0.0 


0.0 


0.0 


0,0 


0.00778 


Drag  coefficient  along  body  longitudinal  axis 


Note:  for  remaining  coefficients,  only  non-negligible  NOS  AIJV  values  are  listed. 


Sway  force  coefficienta 


Coefficients  de.scribing  sway  forces  from 

-3.43  E-2 

resolved  lift,  drag  and  fluid  inertia  along  body 

-1.78  E-1 

lateral  axis.  These  occur  in  response  to 

-1.07  E-1 

individual  (or  multiple)  velocity,  acceleration 

0.0 

and  plane  surface  components,  as  indicated  by 

+  1.18  E-2 

the  corresponding  subscripts. 

+1.18  E-2 

Drag  coefficient  along  body  lateral  axis 

0.5 
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('(lul'fieient 

Nuini* 

Description 

Value  for 

NPS  AUV  11 

Heave  force  coefficients 

2* 

Coefficients  describing  heave  forces  from 

resolved  lift,  drag  and  fluid  inertia  along  body 

vertical  axis.  These  occur  in  response  to 

individual  (or  multiple)  velocity,  acceleration 

and  plane  surface  components,  as  indicated  by 

the  corresponding  subscripts. 

-y.43  E-2 

-2,53  E-3 

^uw 

-7.«44  E-1 

^uq 

-7.013  E-2 

^u\u\6pb 

-2.11  E-2 

^u\ulbpi' 

-2.11  E-2 

Drag  coefficient  along  body  vertical  axis 

0.6 

Roll  moment  coefficients 

fluid  inertia  moment  about  longitudinal  body 

axis  due  to  time  rate  of  change  of  roll  rate  {p) 

-2.4  E-4 

Fluid  inertia  moment  about  longitudinal  body 

axis  due  to  existing  roll  p  and  magnitude  of 

surge  u 

-5.4  E-3 

^i>\p\ 

Drag  moment  about  longitudinal  body  axis  due 

to  signed  square  of  existing  roll  p 

corresponding  to  turbulent  flow 

-2.02  E-2 

estimate 
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1^1 

Name 

Description 

Value  tor 

NI'S  AUV  II 

Diag  moment  about  longitudinal  body  axis  due 

to  existing  roll  p  corresponding  to  laminai’  flow, 

approximately  equals  at  l°/scc 

^p^l(igoo) 

estimate 

Pitch  moment  coefficients 


Fluid  inertia  moment  about  lateral  body  axis 

due  to  time  rate  of  change  of  heave  rate  (li') 

-2.53  E-3 

F'luid  inertia  moment  about  lateral  body  axis 

due  to  time  rate  of  change  of  pitch  rate  {q) 

-6.25  E-3 

F'luid  inertia  moment  about  lateral  body  axis 

due  to  existing  heave  w  and  sui'ge  u 

U.U 

Fluid  inertia  moment  about  lateral  body  axis 

due  to  existing  pitch  q  and  surge  u 

-1.53  B-2 

Drag  moment  force  about  lateral  body  axis  due 
to  bow  plane  deflection  5^  and  signed  square 
of  surge  u 

-U.283-L- 

^u\u\ipb 

Drag  moment  about  lateral  body  axis  due  to 
stern  plane  deflection  8,,,  and  signed  square  of 

surge  u 

+0.377 -L- 

^u\u\bps 

Drag  moment  about  lateral  body  axis  due  to 

signed  square  of  existing  pitch  q 

corresponding  to  turbulent  flow 

-7.0  E-3 

estimate 
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(.'DL'ITident 

Name 

Dusci'iption 

Value  for 

NPS  AUV  11 

Drag  moment  about  lateral  body  axis  due  to 

existing  pitch  q  corresponding  to  laminar'  flow, 

approximately  equals  Af^|^|  at  l°/sec 

^?l9l  [  180° ) 
estimate 

Yaw  moment  coefficients 


b’luid  inertia  moiucnl  about  vertical  body  axis 
due  to  lime  rate  of  change  of  sway  (v) 


b'luid  inertia  moment  about  vertical  body  axis 
due  to  time  rate  of  change  of  yaw  (r ) 


Fluid  inertia  moment  about  vertical  body  axis 
due  to  existing  sway  v  and  surge  u 


Fluid  inertia  moment  about  vertical  body  axis 
due  to  existing  yaw  r  and  surge  u 


Drag  moment  about  vertical  body  axis  due  to 
bow  rudder  dellection  S*,.  and  signed  square  of 
surge  M 


Drug  moment  about  vertical  body  axis  due  to 
stern  rudder  deflection  6„  and  signed  square  of 
surge  u 


Drag  moment  about  vertical  body  axis  due  to 
signed  square  of  existing  yaw  r 
corresponding  to  turbulent  flow 


•1.78  B-3 


-4.7  E-4 


-3.yo  B-3 


+0.283 -L- 

^u|M|6rA 


+0.377 -L- 

Y 

u|u|  brs 


-5.48  E-3 
estimate 
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Naiiiu 


DesL'iiption 


Value  for 
NFS  AUV  II 


Drug  moment  about  vertical  body  axis  due  to 

existing  yaw  r  corresponding  to  laminai’  flow, 

i  180“  j 

approximately  equals  JV^|^|  at  l°/sec 

estimate 

^prop 

Propeller  yaw  moment  for  NFS  AUV  11  is 

Not  used. 

normally  zero  due  to  twin  propellers  that  are 

Previous  values 

identically  paired,  offsetting  and 

are  no  longer 

couiUerrotating,  However  yaw  moments 

arc  not  zero  if  paired  propeller  rpm  values 

differ.  Actual  moments  equal 

^t''prmtUT  ’yprmiur)  propeller,  now 

included  in  yaw  equation  of  motion  (6.53). 

applicable. 

S.  Modifications  to  Previous  Dynamics  Plquations  of  Motion 

Given  these  nomenclature  definitions,  the  next  task  is  to  modify  the 
dynamics  equations  of  motion  to  group  only  body-acceleration-related  terms  on  the 
left-hand  sides,  and  group  velocity-related  terms  on  the  right-hand  sides.  The 
algebraic  transformations  are  similar  for  each  of  the  six  equations  of  motion. 

However  the  surge  equation  requires  a  number  of  important  modifications  and  will  be 
derived  in  detail.  The  surge  equation  describes  the  relationships  between  all  forces 
affecting  the  lineai'  body  acceleration  of  tlie  vehicle  along  the  body  longitudinal  axis. 
The  original  surge  motion  equation  of  (Healey  93,  appends)  includes  accelerations  on 
both  sides  and  appears  as  follows: 

Previous  Surge  Equation  of  Motion  (6.39) 

m  [u  -  vr  +  wq  -  x^ig'^+r^)  +  ya(pq-r)  +  iG(pr+Q)] 

-  lX,u*X^wq*X^vp^X„vr 

bp*^q6bf2^ 

*  (H'-B)  sine 

*  fi’  *  ft" 

+  -2-L^  a^X 

“  ^‘■prop 

The  (Healey  93)  equations  of  motion  described  and  extended  the  earlier 
U.S.  Navy  Swimmer  Delivery  Vehicle  hull  number  9  (SDV-9)  equations  of  motion 
(Smith  7S,  declassified),  which  were  determined  both  empirically  and  theoretically. 

The  e  (q)  term  in  Equation  (6.39)  approximates  a  second-order  speed-related  SDV-9 
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propulsion  response  as  obsei'ved  in  tow  tank  testing.  Tow  tank  testing  is  atypical  for 
most  underwater  vehicles.  Similarly,  5^,2  terms  are  related  to  an  nonstandard  control 
arrangement  in  the  SDV-9  that  included  independent  conti'ol  of  port  and  starboard  bow 
planes.  A  .split  bow  planes  control  configuration  is  not  unusual,  but  more  often  plane 
surfaces  are  controlled  in  pairs.  The  effects  of  individual  planes  have  been  combined 
as  pairs  in  this  model  for  simplicity.  Therefore  the  e  (iD  and  terms  are  not 
included  in  the  general  model  derived  here. 

De.spite  these  reasonable  simplifications  it  is  worth  noting  that  many 
existing  underwater  vehicles  have  asymmetries  and  unique  characteristics  which  may 
not  be  fully  captured  by  these  general  dynamics  equations  of  motion.  Additional 
modifications  to  the  equations  of  motion  may  be  necessai'y  in  some  applications  for 
proper  characterization  of  different  vehicle  designs  (such  as  individually  controlled 
bow  planes).  For  example,  individual  control  of  plane  surface  paks  will  be  necessary 
if  active  control  of  vehicle  roll  during  cruise  mode  is  attempted. 

as  defined  in  the  original  surge  equation  of  motion  of  (Healey  93) 
composes  a  number  of  important  variables  including  commanded  speed,  actual  speed 
and  drag,  The  formulation  is  not  intuitive  from  the  perspective  of  a  general 
description  of  forces.  Fuithermore  the  composition  of  several  variables  as  an  apparent 
constant  is  very  misleading.  The  following  derivation  algebraically  reveals  and 
tearranges  the  component  variables  making  up  the  term.  This  refonnulation 
permits  distinguishing  between  propulsive  force  and  drag  force  contributions  occumng 
along  the  body  longitudinal  direction.  Again  from  (Healey  93): 

(‘•‘"•I 

^  ,  2/i/sec  1  n  ,6,4,, 

(7(X)  rpm  j  u 
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I  2ftl!)ec  \ 

where  woo'pm)  ean  be  referred  to  as  steady-state  speed  per  maximum  propeller  rpm 
ratio. 

Combining  (6.40)  with  (6.41)  and  expanding  the  last  complete  term 
contained  in  the  (Healey  93)  surge  equation  (6.39); 


The  propulsion  conudbution  (due  to  propeller  rpm  n)  and  opposing  drag 
contribution  (due  to  forward  surge  velocity  u)  are  now  evident.  When  the  vehicle  has 
two  propellers,  a  pair  of  forward  forces  contribute  to  the  expected  speed  per  ipm,  and 
the  preceding  X^^op  term  shown  in  Equation  (6.42)  is  expanded  to  become: 


2 


2/?/sec  y 
700  rpm) 


(«portlV«l 


(6.43) 


Force  from  a  single  propeller  out  of  a  pair  is  as  follows.  CoiTesponding  yaw  moment 
contributions  by  each  of  the  propellers  have  been  added  to  the  yaw  Equation  (6.53). 


FsinnU-proptiUr  ~ 


(out  of  a  pair) 


(6,44) 


Examination  of  Equations  (6,43)  and  (6.44)  reveals  that,  as  forward  velocity 
u  increases,  the  effective  forward  thrust  due  to  propeller  rpm  n  decreases  according  to 
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the  expected  signed  square  law,  similar  to  a  pump  curve  of  shaft  rpm  versus  pressure 
head.  Note  that  these  equations  also  accurately  describe  drag  forces  against  forward 
motion  when  a  moving  vehicle’s  propellers  are  turned  off.  Extensive  test  tank 
experimental  data  is  not  needed  for  measuring  this  predominant  relationship  between 
propeller  thrust  and  forward  speed.  A  straightforward  measurement  of  steady-state 
speed  for  maximum  propeller  iprn  precisely  quantifies  this  relationship. 

Cross-body  thruster  propulsion  terms  have  also  been  added  to  the  dynamics 
equations  of  motion.  Steady-state  thruster  force  is  closely  proportional  to  the  .signed 
square  of  ordered  motor  voltage  for  the  cross-body  thrusters  designed  and  consttucted 
for  the  NPS  AUV  11  (Cody  92)  (Healey  94b).  This  signed  square  relationship  between 
control  voltage  and  effective  thruster  force  is  shown  in  Equation  (6.45''.  The  sign 
convention  for  thruster  voltages  is  that  positive  voltage  results  '  force  which  pushes 
the  vehicle  in  the  positive  direction  of  the  body  lateral  or  depth  axes.  More  precise 
modeling  of  thruster  nonlinearities  and  sinusoidal-exponential  time  response  is  possible 
using  generalized  tunnel  thruster  dynamics  models  (Cody  92)  (Healey  94b) 

(Brown  9?)  (Belton  93)  (Fossen  94).  Dynamics-based  models  of  thruster  response 
must  be  used  instead  if  thruster  temporal  response  is  significant.  Similar  results  have 
been  found  for  other  thrusters  that  include  thrust  controller  circuitry  (Sagatun  91) 
(Marks  92).  A  nontemporal  signed  square  voltage  model  was  found  to  be  reasonably 
accurate  for  the  overall  effects  of  the  NPS  AUV  thrusters.  Open  loop  test  tank 
experiments  can  quantify  installed  thruster  performance  versus  time  with  little 
difficulty. 

Since  an  accurate  force  equation  is  available  to  model  the  four  individual 
thrusters,  force  and  moment  terms  can  be  added  directly  to  the  sway,  heave,  pitch  and 
yaw  equaticns  of  motion.  Physical  offsets  of  thruster  centerline  away  from  the  vehicle 
centroid  are  multiplied  against  forces  to  obtain  conesponding  moments,  as  shown  in 
Equation  (6.46).  Opposing  moments  due  to  forward  and  aft  tfu'usters  are  accounted 
for  by  positive  and  negative  thruster  tube  offset  distances,  respectively.  This 
eliminates  the  need  for  the  previous  fomiulation. 
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p 

thruster 


(6.45) 


2.0  lb 
,24^  volts, 


tkrustir  I  ^  thrustir  I 


^O'n^'^^thruster 


I 


\ 


2.0  Ih 

24^  volts  j 


V  \V  I 

thruster  I  thruster  I 


distance 


(6.46) 


The  addition  of  thruster  forces  and  moments  is  required  to  extend  the 
(Healey  V3)  model  to  remain  valid  at  low  forward  speeds  (i.e.  hovering  mode). 
Corresponding  damping  moments  must  also  be  included  to  model  the  resistance  of 
water  against  rotational  motion  in  these  directions.  Previously  existing  drag  terms 
each  include  surge  u  as  a  factor,  and  each  approaches  zero  at  the  low  forward  speeds 
associated  with  hovering.  Therefore  new  rotational  damping  drag  temis  must  be 
included  to  account  for  skin  friction,  particularly  at  low  speeds.  and  ai'e 

coefficients  for  quadratic  terms  corrc.sponding  to  turbulent  boundary  layer  skin  friction. 
Kp,  /V/^,  and  N,  are  coefficients  for  linear  terms  corresponding  to  laminar  boundary 
layer  .skin  friction.  As  sugge.sted  by  (Sagatun  91)  (Fossen  94),  all  six  of  these  skin 
friction  damping  terms  have  been  added  to  rotational  dynamics  equations  of  motion 
(6.51)  through  (6.53)  respectively.  and  terms  are  no  longer  needed,  for 
reasons  analogous  to  those  presented  for  previously. 

One  additional  function  needed  for  the  dynamics  equations  of  motion  is 
L/^^,  a  normalizing  quantity  for  cross-body  fluid  flow  with  respect  to  body  distance  x 
along  the  vehicle  longitudinal  axis.  From  (Healey  93): 

=  v(v  +  (w  -xq)^  (6.47) 


Related  functions  h(x)  and  b(x)  in  Table  6.2  and  the  dynamics  equations  of  motion  are 
provided  for  the  NPS  AUV  by  a  table  of  cross-sectional  measurements  (Marco  95). 


_ E 
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This  is  un  example  of  strip  theory  which  divides  tlie  body  of  a  submerged  vehicle  into 
multiple  parallel  strips,  estimates  hydrodynamic  coefficients  for  damping  and  added 
mass  over  each  strip,  and  then  sums  the  contribution  over  each  strip  to  produce  overall 
coefficient  estimates  (Fossen  94).  Alternative  methods  of  calculating  cross-body  flow 
forces  and  moments  appear'  in  (Humphreys  91). 

Some  additional  explanation  is  necessary  for  time-varying  forces.  So-called 
"added  mass"  forces  are  related  to  the  resistance  of  the  surrounding  fluid  to  vehicle 
body  acceleration.  This  physical  behavior  is  predictable  and  reasonably  intuitive: 
acceleration  of  the  immediately  adjacent  water  volume  requires  a  corresponding  force, 
and  is  thereby  referred  to  as  an  "added  mass"  effect.  These  forces  ai'e  only 
proportional  to  vehicle  accelerations  and  not  vehicle  velocities.  This  characteristic  of 
a  rigid  body  interacting  with  a  fluid  medium  helps  to  explain  why  the  body  frame 
mass  matrix  [M]  (which  corresponds  to  vehicle  mass,  moments  of  inertia  and  "added 
mass")  is  time  invariant. 

Replacement  of  the  and  similar  terms,  removal  of  the  e  (ri)  and  5^/2 
terms,  including  added  mass  terms,  standardizing  explicit  nomenclature  for 
hydrodynaiiiies  coefficients,  and  grouping  body  accelerations  on  the  opposite  sides 
from  velocities  now  produces  the  desired  form  of  the  surge  equation.  Transformation 
of  the  remaining  five  equations  of  motion  for  sway,  heave,  roll,  pitch  and  yaw  is 
similarly  performed  by  duect  algebraic  manipulation  from  those  versions  presented  in 
(Healey  93).  Thruster  forces,  thruster  moments,  propeller  yaw  moments  and  damping 
drag  moments  have  been  added  where  appropriate. 

9.  Dynamics  Equations  of  Motion 

The  critical  contribution  of  this  chapter  is  the  unambiguous  definition  of 
variables  and  coefficients,  and  a  revised  set  of  underwater  vehicle  dynamics  equations 
of  motion.  These  equations  and  the  accompanying  hydrodynamics  model  are 
implemented  verbatim  in  the  accompanying  virtual  world  soui'ce  code  (Brutzman  94e). 
Final  and  complete  forms  for  all  six  dynamics  equations  of  motion  follow. 
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Surge  Equation  of  Motion 
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Heave  Euuation  of  Motion 


(6.50) 
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Roll  Equation  of  Motion 
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Yaw  Equation  of  Motion 


(6.53) 


myaU 


-  —L^NJv  + 


‘  2 


P  r  5) 


[-(/,  -  /,)P9  +  />“  -  Q^)  ^  Jy,Pr  -  l^Qr] 

-  m\x^.{ur  -  wp)  -  ya{-vr  +  w^)] 

H-  ^L\N^pq  +  N^^qr  +  N,|,|r|rl  +  N^r] 

+  ^L\N^up  +  N^ur  •>  iV^v9  +  N^^wp  +  iV^^wr] 

+  ■|L3[iV„,C/v  +  -  JV,|„|6„5„)] 


+  {XqW  -  jc^B)  cos(e)  sin(4))  +  (y^W  -  y^B)  sin(6) 


V 


2  lb 
24^  vo/to 


bow-Uutrai  I  ^bow -lateral  I  ^bow-laural 


^surn -kuaral  I  ^j<«ni  -ioMra/ 1  ^rttrn -laural 


^ port-proptlUr  y port-prop*Uor  ~  ^ stbd-prop*lkr  y stbd-prcp4lUr 


10.  Mass  and  Inertia  Matrix  [M] 

Matiix  equations  can  now  be  written  from  the  dynamics  equations  of 
motion  (6.4^)  through  (6.53),  grouping  significant  terms  together  appropriately.  The 
left-hand  sides  are  simply  written  in  mati'ix  form  as  the  product  of  the  body  coordinate 

frame  mass  matrix  [M\  and  the  time  rate  of  change  of  velocities  matrix  The 

force  matrix  \F\  is  a  (6  x  1)  matrix  compri.sed  of  the  right-hand  sides  of  the  six 
dynamics  equations  of  motion. 

The  body  coordinate  frame  mass  mauix  [M\  is  determined  from  the 

coefficients  corresponding  to  linear  and  rotational  components  of  on  the 

left-hand  side  of  the  given  equations  of  motion  (6.48)  through  (6.53).  When  expressed 
properly,  this  muss  matrix  is  time-invariant  and  does  not  include  any  velocity-related 
terms.  All  possible  added  mass  terms  are  included  here  for  completeness,  even  though 
many  of  the  terms  are  likely  to  equal  zero  (Fossen  94). 
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The  spatial  distribution  of  mass  within  a  body  has  several  important  effects 
which  are  quantified  as  moments  of  inertia.  Calculation  of  inertial  moments  are  as 
shown  in  Equations  (6.55)  through  (6.60).  In  practice  these  calculations  are  performed 
as  weighted  sums,  measured  from  vehicle  origin  to  centers  of  mass  for  individual 
internal  vehicle  components.  If  the  vehicle  has  a  variable  ballast  system,  changes  of 
mass  and  inertial  moment  must  be  accounted  for  and  then  the  body  frame  mass  mati’ix 
LM]  becomes  slowly  time-vai'ying. 

4  =  / 

I,  -  +  z^)dm 

I  (x^  +  y^}dm 
-  jxy  dm 

Mass  matrix  inversion  can  be  accomplished  via  any  of  several  algorithms 
(Press  92)  (Hamming  86).  Note  that  since  the  body  frame  mass  matrix  [Af]  is 
ordinarily  time-invariant,  the  inver.se  mass  matrix  [yW]'‘  does  not  have  to  be  determined 
repeatedly.  Thus  the  computational  efficiency  of  this  large  matrix  inversion 


(6.55) 


(6.56) 


(6.57) 


(6.58) 


(6.59) 


(6.60) 


1.52 


calculation  has  no  effect  on  the  real-time  responsiveness  of  the  hydrodynamics  model 
algorithm.  If  total  vehicle  mass  or  inertial  moment  changes  due  to  variable  ballast  or 
significant  moving  internal  components,  the  matrix  inversion  calculation  will  have  to 
be  occasionally  repeated  and  may  impact  real-time  response, 


153 


11.  Summary  of  Hydrodynamics  Model  Algorithm 

All  of  the  components  of  the  general  underwater  vehicle  real-time 
hydrodynamics  model  have  been  presented.  Figure  6.5  summarizes  the  hydrodynamics 
model  algorithm. 

•  Estimate  and  invert  mass  matrix  [M]  using  equation  (6.54) 

•  Initialize  hydrodynamics  model  variables  for  posture  [/*],  velocities  [\^ 
and  time  rates  of  change  of  velocities  using  Table  6.1 

•  Loop  until  robot  is  done: 

receive  updated  .state  vector  from  robot,  including  ordered  effector 
values  for  rudders,  planes,  propellers,  thrusters  and  elapsed  time 

Calculate  new  values  for  time  rate  of  change  of  body  velocities,  using 
the  current  vehicle  state  vector  and  equation  of  motion  right-hand 
sides  using  Table  6,2,  equations  (6.24),  (6.30),  (6.35),  and 
(6.48)  through  (6.53) 

-  Update  velocities  using  equation  (6.31) 

Perform  transformation  to  using  equations  (6.5),  (O.D),  (6.10), 

(6.11),  and  (6.22) 

Update  posture  [F]  using  newly-calculated  velocities 

ocean  current  estimate  and  previous  posture  using  equation  (6.33) 

Return  newly-calculated  hydrodynamics  values  to  robot  via  telemetry 
update  of  the  robot  state  vector.  Most  calculated  velocities  and 
accelerations  correspond  to  real-world  values  provided  by  inertial, 
flow  and  pressure  sensors. 

Wait  for  next  updated  state  robot  vector.  Continue  loop  upon  receipt. 
Shutdown  when  model  is  no  longer  required  by  robot. 

Figure  6.5.  Underwater  vehicle  real-time  hydrodynamics  modeling  algorithm. 
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K.  KULER  AN(iLE  METHODS  COMPARED  TO  QUATERNION  MK:TH0DS 

The  hydrodynamics  model  presented  here  is  bused  on  Euler  angle  representations 
of  vehicle  orientation.  Another  po.ssible  representation  method  of  interest  is  the  unit 
quaternion.  The  u.se  of  quaternions  is  most  notable  for  a  lack  of  singularity  when 
pointing  vertically,  and  also  for  well-developed  mathematics  that  pennits  rapid  and 
efficient  orientation  update  rates  (Cooke  92b)  (Kolve  93)  (Chou  92)  (Funda  90) 
(Shoemake  85).  This  section  briefly  describes  quaternion  mathematics  as  a  possible 
alternative  to  Euler  angle  orientation  calculations  in  the  underwater  vehicle 
hydrodynamics  model. 

The  underlying  mathematical  reason  that  an  Euler  angle  rotation  matrix  is  unable 
to  satisfactorily  represent  a  vehicle  pointing  vertically  (along  the  z-axis)  is  tliat 

extraction  of  Euler  angles  provides  a  unique  value  for  pitch  (6  =  ±Tt)  but  can  only 

provide  the  sum  (<J)  +  xjf,  nose  up)  or  difference  (<j)  +  i);,  nose  down)  of  roll  and  yaw, 
not  unique  values  for  each.  Thus  three  parameters  arc  inadequate  to  unambiguously 
represent  all  possible  orientations  as  desired.  Sh  William  Rowan  Hamilton  deduced 
and  developed  quaternion  algebra  in  1843  after  searching  many  years  for  a 
generalization  of  complex  numbers.  He  determined  that  four  parameters  are  necessary 
to  represent  all  po.ssible  orientations  without  potential  mathematical  singularity 
(Cooke  92b). 

Consider  the  unit  sphere  as  illustrated  in  Figure  6.6.  Three  parameters  are 
necessary  to  describe  a  unit  vector  directed  from  the  center  to  any  point  on  the  sphere 
surface.  A  fourth  parameter  can  then  be  used  to  describe  a  value  for  rotation  about 
this  axis.  This  combination  of  unit  vector  and  axial  rotation  uniquely  defines  all 
po.ssible  orientations,  provided  rotation  values  are  specified  to  have  a  range  [O.-Iii) 
(Euler’s  Theorem). 
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Figure  6.6.  Quaternion  representation. 


There  are  several  ways  to  represent  quaternion  values,  described  in  detail  in 
(Cooke  92a.  92b)  (Kolve  93)  (Chou  92)  (Funda  90)  (Maillot  90)  and  (Shoemake  85). 

The  simplest  representation  is  to  scale  three  orthogonal  unit  vectors  i  ,  / ,  and  Jc  to 

indicate  a  point  in  three  space,  and  then  combine  those  three  terms  with  another  value 
for  rotation  about  the  described  axis  as  follows: 

Q  =  }V  +  iX^/Y  +  /cZ 

The  Euler  parameter  representation  follows  an  Euler  angle  approach  to  state  that 
three  angles  A,  B  and  C  can  provide  a  rotation  matrix  that  will  align  a  rotation  axis 
with  the  world  coordinate  frame.  A  fourth  angle  D  describes  rotation  about  this  axis. 
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Rather  than  use  A,  B,  C  and  1)  directly,  a  unit  quaternion  Q  is  represented  using  the 
t'ollov,'ing  substitutions: 


Q  =  {Qo>  '?t»  ^3) 

where 


^3  =  cos(C) 


(6.62) 


(6.63) 


The  four  component  values  of  quaternion  Q  are  called  Euler  parameters.  Expressing 
quaternions  using  Euler  parameter  form  is  desirable  due  to  improved  computational 
efficiency  during  arithmetic  operations.  Normalization  may  be  periodically  required 
after  numerical  calculations  to  ensure  that  magnitude  of  each  unit  quaternion  vector 
remains  equal  to  unity  (Cooke  92b). 

One  important  property  of  unit  quaternions  as  described  above  is  especially 
useful.  Multiplication  of  two  unit  quaternions  produces  a  new  unit  quaternion  which 
represents  the  results  of  two  successive  corresponding  rotations. 

<?•<?!  =  (W  +  iX  +JY  +  f^Z)  +  iXj  +  /Tj  +  fiZ^) 

=  '  {WW,  -  XX,  -  YY,  -  ZZ.) 

, '  '  ^  ^  (6.64 

+  i  [XW^  +  PFXj  -  ZTj  +  yZj) 

+  /  [YW^  +  ZX,  -  +  XZj) 

+  fc  [ZW^  +  rXj  -  XTj  +  WZ^) 
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Angular  velocity  of  a  rigid  body  can  be  converted  from  body  coordinate  frame 
angular  velocities  to  quaternion  rates  as  follows: 


%  =  ^  <li<l  *  93'") 

^  Qtr  -  q^q) 
^2=  \(qoQ  ^  q^p  -  qif) 
^3=  {(qor  +  q^q  -  q^p) 


(6.65) 


Given  an  initial  orientation  represented  by  a  quaternion  Q,  orientation  updates 


are  obtained  by  periodically  integrating  quaternion  Q  using  quaternion  rate  Q  and 
time  step  (8/)  via  any  numerical  integration  method. 


Euler  angie.s.  if  needed,  are  then  extracted  from  the  updated  quaternion  ^  5^ 
as  follows  (Cooke  92b): 


0  =  siii-*(-2(^,^3  - 


(6.66) 


i|r  =  cos' 


qi 


qi 


ql 


^3 


cos(0) 


•sign(gi^2  +  q^q^) 


(6.67) 


^  =  cos 


-1 


ql  - 


qi 


ql 


cos(0) 


•sign(g2^3  +  ^o^i) 


(6.68) 


Note  that  the  vertical  restrictions  on  the  range  of  pitch  angle  0  from 
Equation  (6.2)  remain  unchanged  in  Equations  (6.67)  and  (6.68)  when  converting  from 
the  quaternion  representation  back  to  Euler  angles.  Further  mathematical 
manipulations  of  the  quaternion  will  not  produce  values  for  ({>  or  \\f.  However,  unlike 
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the  singularity  in  Euler  rates  at  0  =  ±n:/2,  there  is  no  corresponding  singularity  in  the 
quaternion  rates  of  Equation  (6.65). 

The  principal  drawback  to  using  quaternions  in  an  underwater  virtual  world 
hydrodynamics  model  is  greater  computational  complexity  when  calculating  Euler 
angles,  which  are  needed  for  networked  posture  update  reports.  The  principal 
advantage  of  quaternion  arithmetic  is  that  computational  complexity  is  less  than  Euler 
angle  methods  when  .solely  calculating  rotational  updates  (Cooke  92b).  In  the  current 
implementation  of  the  vinual  world,  Euler  angles  are  required  at  every  time  step,  in 
order  to  produce  .sensor  values  in  the  vehicle  state  vector  and  in  order  to  provide  DIS 
network  updates.  Thus  Euler  angle  methods  are  used  in  the  hydrodynamics  model 
implementation  (Brutzman  94e).  These  requirements  might  change  if  another  vehicle 
without  sucH  sensors  were  modeled.  If  no  virtual  vehicle  yaw,  pitch  or  roll  sensors 
arc  being  modc-ed,  or  if  DIS  network  updates  are  infrequent,  the  periodic 
computational  drawback  of  quaternion  conversions  to  Euler  angles  might  become 
negligible.  The  mathematical  methodology  presented  in  this  section  demonstrated  how 
to  utilize  quaternions  for  recording  and  updating  orientation  rotations  in  the 
hydrodynamics  model,  as  an  alternative  to  Euler  angle  methods.  Detailed  comparisons 
of  computational  efficiency  including  network  considerations  appear  in 
(Cooke  92a,  92b). 

F.  DISTRIBUTED  INTERACTIVE  SIMULATION  (DIS)  AND  NETWORK 
CONSIDERATIONS 

Distributed  Interactive  Simulation  (DIS)  is  the  IEEE  standard  protocol  (IEEE  93) 
used  for  communicating  between  networked  entities  sharing  the  same  virtual 
environment  In  order  for  a  robot  operating  in  a  virtual  world  to  be  visible  to  other 
entities,  DIS  Protocol  Data  Units  (PDUs)  are  sent  out  at  regular  intervals.  The 
purpose  and  implementation  of  the  virtual  world  DIS  interface  are  presented  separately 
in  the  network  considerations  chapter.  This  section  examines  the  specific  requirements 
of  the  hydrodynamics  model  that  pertain  to  DIS. 
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The  purpose  of  the  hydrodynamics  model  is  to  provide  valid  real-time  response 
to  a  networked  robot  operating  in  a  virtual  world.  The  hydrodynamics  model  is 
complex  and  sophisticated.  A  wide  variety  of  subtle  physical  responses  are  possible. 
One  current  focus  of  research  interest  is  examining  the  precise  interactions  that  occur 
between  robot  and  hydrodynamics  models.  Fine-grained  reproduction  of  every 
interaction  is  therefore  desirable  for  scientific  purposes,  if  supportable  by  the  network 
and  virtual  world  viewer  programs.  Reproduction  of  AUV  state  at  the  .same  rate  as 
interactions  between  the  robot  and  the  hydrodynamics  model  is  conespondingly  useful 
for  visualization  of  both  robot  vehicle  performance  and  hydrodynamics  model 
performance.  Currently  this  interaction  rate  is  ten  times  per  second  (10  Hz). 

The  DIS  protocol  requires  that  entities  announce  tlieir  position  at  intervals  not  to 
exceed  5  seconds  so  that  other  entities  are  aware  of  their  "live"  presence  (IEEE  93), 

In  practice  an  inteiwal  of  one  to  three  seconds  is  typically  used  for  entities  such  as 
ground  vehicles  which  usually  move  with  constant  linear  velocity.  Highly  dynamic 
vehicles  such  as  jet  aircraft  may  announce  posture  data  many  times  per  second  in 
order  to  permit  smooth  refresh  rates  of  rapidly  varying  postures  (Towers  94).  In  order 
to  reduce  unnecessary  network  traffic,  adaptive  time  steps  between  PDUs  are 
recommended  which  only  broadcast  new  values  when  predicted  dead-reckoning  en'or 
exceeds  a  reasonable  threshold  (or  when  the  5  second  keep-alive  deadline  is  reached). 
Choice  of  dead  reckoning  algorithm  and  other  pai'arneters  can  also  reduce  network 
loading  (Lin  94).  In  general,  minimizing  PDU  traffic  is  important  to  reduce  network 
bandwidth,  and  also  to  reduce  the  processing  load  on  each  DIS  receiver.  These 
bandwidth  considerations  grow  in  importance  when  the  number  of  actively 
participating  entities  becomes  large,  and  also  when  using  multicasi.  DIS  which  can 
have  world-wide  Internet  scope  (Macedonia,  Brutzman  94). 

Although  linear  and  rotational  velocities  and  accelerations  of  an  underwater 
vehicle  are  orders  of  magnitude  lower  than  Jet  aircraft,  underwater  vehicle  behavior  is 
highly  dynamic  nevertheless.  Example  missions  demonstrating  highly  complex 
interrelation.ships  among  vehicle  state  variables  appear  in  the  experimental  results 
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chapter  and  suttware  distribution  (Brutzman  94e).  For  some  missions,  frequent 
posture  updates  are  necessary  to  closely  evaluate  vehicle  interaction  with  hazardous 
environments  in  close  quarters  (such  as  a  minefield).  Precise  posture  information  is 
also  necessary  to  indicate  interactions  of  propulsor  flow  and  sonar  sensors  with  the 
environment.  Currently  thrust,  control  plane  and  .sonar  values  are  embedded  as 
"articulated  parameters"  within  individual  DIS  entity  state  PDUs  for  the  NPS  AUV. 
Future  versions  of  the  DIS  standard  are  expected  to  provide  new  PDU  types 
specifically  designed  for  announcing  sonar  transmissions,  but  hydrodynamics  flow 
vectors  (proportional  to  propulsor  values)  will  continue  to  be  inferred  from  the  vehicle 
entity  state  PDU  articulated  parameter  values. 

Entity  state  PDUs  must  contain  posture  values  and  can  optionally  include  linear 
velocity,  angular  velocity,  and  linear'  acceleration.  Dead  reckoning  algorithm  velocities 
and  accelerations  may  be  in  world  or  body  coordinates.  Body  accelerations  ar'e  not 
explicitly  defined,  but  (Towers, 94)  presents  two  dead  reckoning  algorithms  pertaining 
to  each  of  two  possible  body  acceleration  definitions.  Of  particular'  note  are 
experimental  results  which  show  that  average  proce.ssing  time  of  world  coordinate 
frame  PDUs  is  only  X()%  relative  to  body  coordinate  frame  PDUs  (Towers  94).  On 
the  other  hand,  a  computational  drawback  in  tlie  use  of  world  coordinate  frame  PDUs 
here  is  tlie  fact  that  th“  underwater  vehicle  hydrodynamics  model  does  not  directly 
provide  aceelerations  in  the  world  coordinate  frame.  The  current  DIS  implementation 
in  the  undervater  virtual  world  utilizes  world  coordinate  frame  PDUs  becau,se  they  arc 
more  elficient  fur  receivers  and  less  expensive  to  render.  Future  work  of  interest 
includes  implementing  a  selectable  alternative  encoding  of  entity  state  velocities  and 
accelerations  in  body  frame  coordinates,  and  then  empirically  evaluating  whether 
virtual  world  efficiency  is  degraded  by  shifting  PDUs  to  body  coordiiicUes.  Dead 
reckoning  algorithm  efficiency  and  evaluation  is  further  discus.sed  in  (Lin  94). 
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(J.  OBJECT-ORIENTED  NETWORKED  RKJID  BODY  DYNAMICS  CLASS 

HIERARCHY 

Physically  based  modeling  includes  dynamics  (modeling  forces  and 
accelerations)  as  well  as  kinematics  (modeling  velocity  effects  only).  Dynamics 
considerations  are  a  superset  of  kinematics.  The  implementation  of  the  underwater 
vehicle  hydrodynamics  model  was  designed  to  incorporate  the  principles  of 
object-oriented  programming  (encapsulation,  inheritance  and  polymorphism)  and 
structured  programming  (top-down  design,  modularity  and  data  abstraction)  as 
appropriate  (Booch  91)  (Barr  91)  (Stroustiup  91)  (Frakes  91)  (Barzel  92)  (Pohl  93) 
(Bailey  94).  The  many  good  design  and  software  engineering  principles  found  in 
these  references  were  valuable  in  managing  the  complexity  of  the  hydrodynamics 
model,  and  also  in  building  a  general  dynamics  model  that  can  be  easily  adapted  to 
other  underwater  vehicles  (or  even  other  vehicle  types).  Although  no  single  software 
engineering  methodology  was  rigidly  adhered  to,  the  resulting  model  implementation 
(written  in  C++)  enjoys  most  of  the  benefits  which  motivate  these  various  references. 
Model  structure  is  briefly  presented  here  and  further  described  in  (Brutzman  94e). 

Structuring  the  model  design  problem  was  the  key  to  comprehensible 
implementation.  A  straightforward  hierarchy  follows.  Posture  is  common  to  all 
vehicles  and  can  be  represented  either  by  Euler  angles  by  Euler  angles  embedded  in  a 
homogenous  transformation  matrix  (Fu  87)  (Foley,  van  Dam  90),  or  by 
quaternions  (Cooke  92b).  A  rigid  body  is  subject  to  kinematics  equations  of  motion 
which  combine  velocities  with  postures  in  strictly  defined  ways  regardless  of  vehicle 
type  or  environmental  dimensionality.  A  networked  rigid  body  which  communicates 
with  other  entities  via  DIS  needs  to  calculate  nn.stures,  optional  linear  and  rotational 
velocities,  and  (again  optional)  linear  accelerations.  Such  a  DIS-networked  rigid  body 
has  identical  capabilities  regai'dless  of  vehicle  type.  An  entity  dynamics  component 
for  a  real-time  networked  virtual  world  combines  the  functionality  of  rigid  bodies  and 
DIS  networking  with  the  dynamics  equations  of  motion  (forces  and  accelerations) 
unique  to  a  specific  vehicle  type.  This  .structured  hierarchy  of  relationships  between 
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posture  representations,  rigid  bodies,  DIS  networking  and  dynamics  equations  of 
motion  led  to  the  general  model  class  diagram  which  appears  in  Figure  6.7. 

dhe  compartment  boxes  in  Figure  6.7  delineate  the  functionality  of  class 
components.  I'he  first  compartment  is  class  name.  The  second  compai'tment  indicates 
member  data  fields,  which  are  the  data  structures  encapsulated  by  the  object.  The 
third  compartment  indicates  object  methods  (functions)  which  effectively  occur 
instantaneously.  The  fourth  compartment  includes  methods  (functions)  which  are 
time-consuming,  either  from  the  perspective  of  simulation  clock  duration  or  actual 
delay  tlue  to  network  latency.  Adapted  from  the  Object-Oriented  Simulation  Pictures 
(OOSPICs)  design  and  testing  methodology  (Bailey  94).  this  diagraming  approach  is 
very  useful  because  it  simplifies  pre.sentation  of  key  object  relationships  and  clarifies 
hierarchy  design.  Of  particularly  value  is  the  explicit  specification  of  temporal 
relationships,  which  are  critical  to  success  in  a  real-time  system  and  are  often 
overlooked  in  complex  system  design.  An  example  object  template  which  adapts  the 
OOSPICs  methodology  from  MODSIM  programming  language  to  C++  appears  as 
Figure  6.X.  A  key  for  OOSPIC  arrow  conventions  is  included  in  Figure  6.9 
(Bailey  94).  Software  source  code  throughout  the  hydrodynamics  class  library 
implementation  (Brutzman  94e)  follows  the  structural  layout  presented  in  the  OOSPIC 
diagram  of  Figure  6.X. 
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Fijjurc  6.7,  General  real-time  DlS-network.ed  hydrodynamics  model  class  hierarchy. 
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Figure  6.8. 


Figure  6.9. 


OOvSPlC  class  diagram  template  for  C++  class  definitions. 
Sepai'ation  of  class  name,  data  fields,  instantaneous  methods  and 
time-consuming  methods  clarifies  class  functionality  and  design. 
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The  structure  of  the  general  real-time  DlS-networked  dynamics  model  presented 
here  appears  to  be  applicable  to  vehicles  of  arbitrary  type.  Documented  source  code 
matches  the  diagrams,  equations  and  algorithms  presented  in  this  work 
(Brutznian  94e).  Future  work,  of  interest  in  model  design  includes  determining  new 
paianreter  values  using  this  model  to  emulate  the  characteristics  of  other  underwater 
vehicles,  adapting  the  model  to  accommodate  dissimilar  vehicle  entities,  porting  the 
model  into  robot  software  as  an  on-board  hydrodynamics  response  predictor,  and 
investigating  extensions  to  the  model  to  support  visualization,  validation  and 
verification  of  model  relationships  against  archived  or  live  data  records  of  actual 
vehicle  dynamics  performance. 

H.  SIMULATINC;  ON-BOARD  INERTIAL  SENSORS 

Navigation  and  position  keeping  ai'e  fundamentally  important  capabilities  for  an 
AUV.  Unfortunately  the  selection,  purchase,  installation,  calibration,  testing  and 
interpretation  of  sensors  is  time  consuming  and  expensive.  A  valuable  benefit  of  a 
networked  hydrodynamics  model  is  that  it  can  provide  model  values  for 
"virtual  sensors"  which  may  or  may  not  be  physically  installed. 

There  are  three  types  of  navigational  .sensors  in  common  use:  sonar', 
electromechanical  and  inertial.  Navigational  sonar  .sensors  either  detect  the 
environment  or  use  doppler  difference  ranging  from  beacons  at  known  locations,  and 
as  such  are  not  appropriately  modeled  using  hydrodynamics  parameters.  Mechanical 
or  electrical  sensors  for  water  flow,  depth  pre.ssure,  plane  position,  propulsor  rpm  and 
buttery  amp-hour  consumption  rate  are  directly  represented  by  model  variables  tor 
surge  «,  deptlt  z  and  vehicle  state  vector  values  re.spectively.  Normally  these  sensors 
are  reasonably  accurate  with  zero  bias  and  less  than  5-10%  error  over  their  operating 
range.  Inertial  and  gyro.scopic  detectors  can  also  be  modeled  but  additional 
considerations  pertain. 

Inertial  navigation  sensors  are  often  called  "strap-down"  systems  since  they  are 
aligned  with  vehicle  body  coordinates  and  physically  fixed  to  the  vehicle  frame. 
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11'  possible  they  are  kept  near  the  center  of  gravity  to  minimize  offset  moment  effects. 
Complete  packages  using  .solid  state  sensors  and  integrated  circuit  processing  ai'e  now 
available  at  relatively  low  cost,  providing  angular  rate  and  acceleration  values  about 
all  three  body  axes.  Many  other  small  inertial  units  are  also  available  which  can 
provide  similar  functionality  for  one  or  two  body  axes.  'Velocity  outputs  are  integrated 
internally  from  accelerations,  and  posture  values  are  then  found  by  integration  of 
velocity. 

Accuracy  of  i  rtiai  devices  depends  on  pitch  and  roll  angle  estimation  and 
sensitivity  to  acceleration.  Inertial  accelerometers  are  affected  both  by  accelerations 
on  the  vehicle  and  accelerations  due  to  gravity.  Since  the  acceleration  due  to  gravity 
is  about  ten  times  the  acceleration  of  propulsors  u.sed  by  slow  speed  vehicles,  an 
accurate  estimate  of  vehicle  pitch  and  roll  is  essential  for  isolating  acceleration 
components  unique  to  the  veldele.  Because  both  position  and  rotation  estimates  are 
double  integrations  of  accelerations,  any  noise  or  error  in  acceleration  estimation  is 
gieatly  amplified  over  the  passage  of  time.  Proper  conversion  from  local  inertial 
reference  frames  to  geostationary  or  geocentric  inertial  reference  frames  is  also 
necessary  (Maloney  8X),  Additional  errors  and  correction  liictors  all  can  raise  the 
complexity  of  the  sensor  and  its  model. 

Electromechanical  and  inertial  sensors  can  be  precisely  modeled  by  perfect 
"virtual  sensors"  using  the  hydrodynamics  model.  This  is  very  useful  for  initial 
experimentation  with  navigation  functions  on  the  robot.  For  realistic  modeling, 
however,  accurate  distributions  for  .sensor  bias,  error  and  vtudance  are  needed.  Such 
disU’ibutions  can  only  be  meaningfully  applied  using  specifications  and  test  results  for 
actual  hardware.  Error  models  are  feasible  (Pappas  91)  (Brancart  94)  and  can  be 
modeled  statistically  (Law,  Kelton  91).  Simulating  "virtual  .sensors"  using  the 
hydrodynamics  model  is  of  particular  usefulness  when  evaluating  robu.st  vehicle 
control  under  variable  operating  conditions  (e.specially  simulated  sen.sor  failure).  The 
key  to  success  when  producing  such  simulations  will  be  incorporating  statistically 
valid  error  models. 
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I.  SPECIAL  EFFECTS  AND  FUTURE  WORK:  ROBUST  CONTROL, 


TETHER,  OCEAN  SURFACE,  COLLISION  DETECTION 

The  networked  real-time  availability  of  this  model  enables  further  work  in 
several  important  reseai'ch  areas.  The  analysis  and  design  of  robust  controllers  focuses 
on  producing  stable  performance  when  conU'olling  multivariable  systems  with 
significant  uncertainty  (Dorato  87).  Ordinarily  this  includes  fixed  control  systems  that 
meet  peiformance  measure  criteria  for  specified  uncertainty  bounds.  Example  linear 
control  algorithms  u.sed  in  the  robot  for  posture  control  are  included  in  the  robot 
architecture  chapter  of  this  work.  More  sophisticated  controller  analysis  appears  in 
(Yuerger  85,  90)  (Papoulias  89,  91)  (Cristi  89)  (Healey  89,  92b,  93,  94a)  (Fossen  94) 
and  numerous  other  references.  Adaptive  control  methods  and  application  of  machine 
learning  techniques  to  control  are  active  areas  of  research  (Goheen  87).  This  work  is 
of  particular  interest  given  the  paramount  importance  of  vehicle  stability  despite  any 
potentially  chaotic  (nonlinear  instab  lity)  behavior  which  may  emerge  due  to 
unforeseen  interactions  between  multiple  active  controllers.  The  ability  to  repeatedly 
test  controllers  for  yaw,  depth,  pitch,  tracking  and  hovering  while  they  are  operating 
simultaneously  on  vehicle  hardware  in  real  time  in  the  laboratory  is  a  tremendous 
research  tool  provided  by  this  model  and  the  networked  virtual  world. 

Although  a  tether  is  not  ordinarily  used  on  the  NPS  AUV,  employment  of  a 
tether  for  power  supply,  task-level  mission  control  or  telemetry  feedback  can  be  very 
useful  during  vehicle  te.sting.  Tethers  can  also  be  a  good  way  to  prepare  for  using 
acou.stic  links,  or  to  reliably  test  a  vehicle  in  the  open  o  ean  prior  to  autonontous 
control.  It  is  important  to  note  that  the  openitional  characteristics  of  remotely  operated 
vehicles  are  often  dominated  by  tether  dynamics.  Incorporation  of  a  tether  injects 
significant  forces  and  moments  into  the  equations  of  motion,  but  tether  forces  can  be 
realistically  modeled  (Abel  72)  (Brancarl  94)  (Hover  94).  Addition  of  a  general  tether 
model  into  this  underwater  vehicle  hydrodynamics  model  is  a  valuable  subject  for 
I'll  (lire  work, 
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Modeling  ocean  waves  aiul  surtaee  interactions  are  also  interesting  areas  tor 
future  vsork.  Model  complevity  langes  tioin  sonple  simisoids  to  sonliisticated 
numerical  models  obtained  fiom  superi.  v'mnuter  rr-  jran>  .in,i!>/ing  \ears  'g  emptrkal 
oceanograpliic  data  (Covington  '■•4'  d-osM-ii  04  AtusKer  ss.  Blumbere  'Ui  I  .uallv 
the  principle  ot  super]sosition  permits  wave  ario,  vurren;  ette^ts  rx-  nievied  into  the 
hydrodynamics  nrodel  soluiv-r,  at  '"'c  '  a'g  '■•s.,.  ^  ^,..p 

eomplev  ocean  wave  atui  ..I'va.ati.  a  m.  xte.-  .a;  'xr  >  e  t  ”  •  '  -  parallel 

Ilk  01  poiation  ot  tiigti  les  1..:.  s  .  s  .  ^ 

anottiei  woitliv  aiea  f.”  tuture  lesear^k 

1  he  hvdnsivnamks  m.si^-,  presctiteO  ne'e  l.se'  KiuOie  ^o-isi.ai  ette>.ts 

Abiupl  changes  m  r'oilv  a».».eleration  and  vel>xitv  nu  paire  ev'ensiotis  the 
temporal  integration  algorithm  [)ete*.ting  collisions  jikI  pouits  ot  c^'Otact  in  a  hienlv 
populated  virtual  woild  is  a  separate  active  leseatch  problem  vvitn  an  evrremelv  high 
degree  of  coiiiputaiumal  complesity  Brojvrlv  adapting  the  n\ dnxlv nainic s  algorithm 
to  inclu'ie  realistic  collision  effects  can  be  done  meamngtulK  it  performed  in 
eonjunetion  with  the  imue  general  virtual  world  collision  detection  problem.  This  is 
another  important  area  for  future  research. 

J.  SUMMARY 

The  requirements  for  a  general  networked  underwater  vehicle  .six 
degree-of-freedom  hydrodynamics  model  are  outlined  for  a  robot  connected  to  a 
virtual  world.  An  overall  comparison  of  vehicle  dynamics  in  other  environments 
shows  that  the  underwater  vehicle  case  is  among  the  most  difficult  and  crucial. 

No  rigorous  general  model  was  previously  available  from  a  single  source  which  is 
computationally  suitable  for  real-time  simulation  of  submerged  vehicle  hydrodynamics. 
The  primary  intended  conti'ibutions  of  the  hydrodynamic  model  developed  here  are 
clarity,  correctness,  generality,  standardized  nomenclature  and  suitability  for  real-time 
simulation. 
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Coordinate  systems,  variable  definitions  and  coefficient  nomenclature  are 
explicitly  defined.  Kinematics  equations  of  motion  reveal  constraints  between 
representations  in  the  body  coordinate  frame  and  world  coordinate  frame.  Restrictions 
on  Euler  angles  when  pointing  vertically  are  examined.  Defining  the  underwater 
vehicle  dynamics  problem  as  a  function  of  vehicle  state  vector  and  hydrodynamics 
state  vector  provides  precise  specifications  of  algorithm  inputs  and  outputs.  Dynamics 
equations  of  motion  are  derived  in  a  form  suitable  for  temporal  integration  in 
real  time.  Dimensionless  coefficient  values  are  presented  for  the  NFS  AUV  and 
methods  are  di.scussed  for  determining  coefficients  of  other  vehicles.  After  extending 
previous  work,  a  full  .set  of  component  dynaiTucs  equations  of  motion  are  presented, 
including  mass  and  inertia  matrix  determination.  The  dynamics  equations  of  motion 
are  in  a  form  suitable  for  most  existing  underwater  vehicles.  Techniques  are 
demonstrated  for  modifying  these  general  equations  to  accommodate  different  vehicle 
physical  configurations.  Since  the  equations  are  written  to  run  in  real  time,  it  may  be 
computationally  feasible  to  embed  them  in  the  robot  execution  logic  as  an  onboard 
hydrodynamics  response  predictor  for  improved  physical  control. 

Quaternion  methods  are  examined  as  a  possible  alternative  to  Euler  angle 
representations.  The  u.se  of  Distributed  Interactive  Simulation  (DIS)  network  protocols 
for  communication  between  virtual  worlds  imposes  special  considerations  on  the 
hydrodynamic  model.  An  object-oriented  networked  rigid  body  dynamics  class 
hierarchy  illuminates  the  design  and  implementation  of  the  hydrodynamics  model. 

This  class  hierarchy  may  also  be  suitable  for  other  types  of  networked  vehicle  models. 
Simulation  of  virtual  sensors,  robust  control,  tether  considerations,  ocean  surface 
modeling  and  collision'detection  are  all  examined  as  possible  components  of  the 
hydrodynamics  model.  Numerous  considerations  in  these  many  ai'eas  are  pointed  out 
as  useful  candidates  for  future  research,  with  the  expectation  that  each  can  be 
implemented  as  compatible  networked  real-time  extensions  to  the  general  underwater 
vehicle  dynamits  model. 
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VII.  (GLOBALLY  NETWQRKKU  3D  (GRAPHICS  AND  VIRTUAL  WORLDS 


A.  INTRODUCTION 

Three-dimensional  interactive  graphics  are  ordinai'ily  concerned  with 
coordinating  a  handful  of  input  devices  while  placing  realistic  renderings  at  fast  frame 
rates  on  a  single  screen.  Networking  permits  connecting  virtual  worlds  with 
distiibuted  models  and  completely  diver.se  inpuLs/outputs  on  a  truly  global  scale. 
Giaphics  and  virtual  world  designers  interested  in  large-scale  interactions  can  now 
consider  the  world-wide  Internet  as  a  direct  extension  of  thek  computer.  A  variety  of 
networking  techniques  can  be  combined  v/ith  traditional  interactive  3D  graphics  to 
collectively  provide  almost  unlimited  connectivity.  In  particular,  four  component 
services  are  proposed  as  being  necessary  and  sufficient  for  virtual  world  networking: 
reliable  point-to-point  socket  communications,  multicast  communications  protocols, 
interaction  protocols  such  as  the  IEEE  standard  Distributed  Interactive  Simulation 
(DIS)  protocol,  and  World-Wide  Web  connectivity. 

The  key  specifications  for  virtual  world  networking  are  tuv  pplication  of 
appropriate  network  protocols  and  careful  consideration  of  bandwidth.  Distribution  of 
virtual  world  components  using  point-to-point  sockets  enables  upwai'd  scalability  and 
real-time  response.  Multicast  protocols  permit  moderately  large  bandwidths  to  be 
efficiently  shared  by  an  unconstrained  number  of  ho.sts.  Applications  developed  for 
the  Multicast  Backbone  (MBone)  permits  open  distribution  of  graphics,  video,  audio, 
DIS  and  other  streams  worldwide  in  real  time.  The  DIS  protocol  enables  efficient  live 
interaction  between  multiple  entities  in  multiple  virtual  worlds.  The  coordinated  u.se 
of  hypermedia  servers  and  embedded  World-Wide  Web  browsers  allows  virtual  worlds 
global  input/output  access  to  pertinent  archived  images,  papers,  datasets,  software, 
sound  clips,  text  or  any  other  computer-storable  media.  Witli  these  four  network  tools 
integrated  in  virtual  worlds,  3D  computer  graphics  can  be  simultaneously  available 
anywhere. 


B.  NETWORKING  BENEFITS 

The  benefits  of  networking  a  virtual  world  are  many  and  worth  enumerating. 

Any  virtual  world  which  attempts  to  model  parts  of  the  real  world  with  nontrivial 
complexity  will  soon  outstrip  the  computational  capabilities  and  real-time  capacity  of 
any  single  computer.  Heterogeneous  processes  need  to  be  able  to  run  on  heterogenous 
processors.  Massive  archived  datasets,  sensor  telemetry,  component  models,  human 
users  and  autonomous  entities  can  connect  to  the  virtual  world  from  wherever  where 
they  exist  in  the  real  world.  This  approach  permits  problem  scalability,  real-time 
response  and  interoperability.  It  also  enables  economies  of  scale  since  the  structure  of 
the  virtual  world  cari  utilize  an  installed  base  of  computers  already  connected  to  the 
Internet  which  numbers  over  twenty  million.  Since  Icnowledge  resource  archiving  and 
human  access  to  the  Internet  is  growing  phenomenally  at  a  sustained  exponential  rate 
of  approximately  20%  per  month,  virtual  world  design  must  address  network 
connectivity  and  access  efficiency  in  scalable  ways. 

C.  BANDWIDTH  SPECIFICATIONS  FOR  VIRTUAL  WORLD 
NETWORKING 

Three-dimensionul  computer  graphics  and  network  communications  are  both 
concerned  with  the  delivery  of  information  streams.  In  each  case  an  all-encompassing 
criteria  is  bandwidth.  In  computer  graphics,  bandwidth  concerns  are  manifested  by 
frame  rate,  image  size,  level  of  detail,  polygon  culling  and  rendering  complexity  due 
to  lighting  models,  texturing  etc.  The  intended  net  result  is  delivery  of  effective  visual 
information  to  a  viewer.  In  networks,  bandwidth  is  primarily  measured  by  the 
information  capacity  of  a  channel  in  kilobits  per  second  (Kbps)  and  is  also  affected  by 
packet  size,  delivery  latency,  network  loading,  transport  reliability  and  processor 
capacity.  The  net  result  is  delivery  of  a  information  stream  to  one  or  multiple 
recipients. 

It  is  useful  to  know  the  bandwidths  of  typical  information  streams  since  they  can 
vary  widely.  Uncompressed  video  bandwidth  transmitted  on  a  netv/ork  can  consume 
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as  much  as  60  Mbps,  A  320x240  pixel  8  bit  color  video  or  graphics  window 
reproduced  by  network  video  tool  nv  requires  128  Kbps  for  1-3  frames  per  second,  or 
256  Kbps  for  3-5  frames  per  second,  where  effective  frame  rate  varies  inversely  with 
the  number  of  pixels  which  vary  from  frame  to  frame.  A  telephone-quality  audio 
channel  (300-3300  Hz)  requires  50-75  Kbps  capacity  depending  upon  the  encoding 
algorithm  employed.  A  musical  instrument  digital  interface  (MIDI)  stream  requires 
32  Kbps.  A  representative  entity  DIS  posture  stream  requires  about  I  Kbps. 

One-time  retrieval  of  data  objects  over  the  Internet  has  highly  variable  bandwidth 
which  is  principally  dependent  on  the  capacity  of  respective  host  connections  and 
current  intermediate  network  loading. 

It  is  similarly  important  to  know  the  capacity  of  various  network  connections. 
Most  local  area  networks  use  Ethernet  which  has  a  maximum  bandwidth  of  10  Mbps. 
Fiber  Distributed  Data  Interface  (FDDI)  is  100  Mbps.  Microwave  wireless  bridges 
used  to  connect  LANs  typically  have  a  bandwidth  capacity  of  1  Mbps.  Modems  on 
standard  telephone  lines  can  only  support  2-20  Kbps.  Typical  fixed  site  connections  to 
the  Internet  are  T1  at  1.5  Mbps,  or  T3  at  45-155  Mbps  (depending  on  whether 
electrical  or  optical  signaling  is  used).  Integrated  services  d'gital  network  (ISDN) 
lines  are  beco.ming  available  to  business  and  home  users,  with  line  capacities  measured 
in  64  or  128  Kbps  increments  up  to  a  total  of  1.5  Mbps.  Frame  Relay  is  a 
commercially  available  switching  technique  that  supports  best-effort  delivery  and 
variable-length  data  frames  at  bandwidths  up  to  2  Mbps.  Broadband  ISDN  (BISDN) 
refers  to  Asynchronous  Transfer  Mode  (ATM)  (also  known  as  Cell  Relay)  which  u.':es 
fixed  length  data  cells  for  switching  bandwidths  up  to  gigabits  per  second.  Depending 
on  contend  on-handling' techniques  used  by  the  corresponding  protocols,  the  effective 
bandwidth  of  each  link  type  listed  above  may  only  be  80-90%  of  the  theoretical 
maximum  before  collisions  and  collision  recovery  becomes  prohibitive. 

In  every  case,  these  various  network  connections  are  only  of  practical  use  to 
globally  networked  3D  graphics  when  they  are  compatible  with  the  Internet  Protocol 
(IP)  suite.  Given  current  implementations  and  eventual  standardization  of  IP  over 
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ATM  (Armitage  94),  IP  compatibility  exists  for  all  of  the  listed  connection  types. 
Relatively  high  frame  rate  graphics  can  be  generated  over  the  Internet  by  low-end 
graphics  workstations,  Simultaneous  duplication  of  graphics-related  streams  at  both 
high  and  low  bandwidths  is  feasible  and  desirable  to  accommodate  these  various 
bandwidth  capacities.  Duplicate  imagery  streams  permits  a  variety  of  users  to 
participate  interactively  via  nearly  any  of  the  network  connections  listed  above. 

1).  TKRMIN()L()(iY  AND  NETWORK  LAYERS 

The  integration  of  networks  with  computer  graphics  and  virtual  worlds  occurs  by 
invoking  underlying  network  functions  from  within  applications.  Figure  7.1  shows 
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Figure  7.1  Correspondence  between  OSI  and  IP  protocol  layer  models,  and 

objects  passed  between  corresponding  layers  on  separate  hosts. 
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how  the  seven  layers  of  the  w'ell-known  Open  Systems  Interconnection  (OSI)  standard 
network,  model  generally  comespond  to  the  effective  layers  of  the  Internet  Protocol 
(IP)  standard.  Functional  characLeristic  definitions  of  the  IP  layers  follow  in 
Figure  7.2. 


o  Process/Application  Layer.  Applications  invoke  TCP/IP  services,  sending 
and  receiving  messages  or  streams  with  other  hosts.  Delivery  can  be 
intermittent  or  continuous. 

o  Transport  Layer.  Provide  host-host  packetized  communication  between 
applications,  using  either  reliable  delivery  connection-oriented  TCP  or 
unreliable  delivery  connectionless  UDP.  Exchanges  packets  end-end  with 
other  hosts. 

o  Internet/Network  Layer.  Encapsulates  packets  with  an  IP  datagram  which 
contains  routing  information,  receives  or  ignores  incoming  datagrams  as 
appropriate  from  other  hosts.  Checks  datagram  validity,  handles  network 
error  and  control  messages. 

o  Data  Link  Layer.  Includes  signaling  and  lowest  level  hardware  functions, 
exchanges  network-specific  data  frames  with  other  devices.  Includes 
capability  to  screen  multicast  packets  by  port  number  at  the  hardware  level. 


Figure  7.2.  Summary  of  TCP/IP  Internet  layers  functionality. 


These  diagrams  and  definitions  are  merely  an  overview  but  help  illustrate  the 
logical  relationship  and  relative  expense  of  different  network  interactions.  In  general, 
network  operations  consume  proportionately  more  processor  cycles  at  the  higher 
layers.  Minimizing  this  computational  burden  is  important  for  minimizing  latency  and 
maintaining  virtual  v/orld  responsiveness. 

Methods  chosen  for  transfer  of  information  must  use  either  reliable 
connection-oriented  Transport  Control  Protocol  (TCP)  or  nonguaranteed  delivery 
connectionless  User  Datagram  Protocol  (UDP).  Each  of  these  protocols  is  part  of  the 
Transport  layer.  One  of  the  two  protocols  is  used  as  appropriate  for  the  criticality  and 
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timeliness  of  the  particula'"  stream  being  distributed.  Understanding  the  precise 
characteristics  of  TCP,  UDP  and  other  protocols  helps  the  virtual  world  designer 
understand  the  strengths  and  weaknesses  of  each  network  tool  employed.  A  great  deal 
more  can  be  said  about  these  and  related  topics.  Since  internetworking  considerations 
impact  all  components  in  a  large  scale  virtual  world,  additional  study  of  network 
protocols  and  applications  is  highly  recommended  for  virtual  world  designers. 
Suggested  references  include  (Internet  94)  (Stallings  94)  (Comer  91)  and  (Stevens  90). 

K.  USE  OF  SOCKETS  FOR  VIRTUAL  WORLD  COMMUNICATION 

The  most  common  use  of  interprocess  communications  (IPC)  among  graphics 
and  virtual  world  component  processes  is  the  socket.  A  socket  is  not  a  protocol  but 
rather  an  application  program  interface  (API)  for  communication  between  processes  on 
different  hosts  (or  a  single  host)  via  the  network  layer  of  the  IP  suite.  Sockets  provide 
a  mechanism  for  passing  data  that  is  either  reliable  connection-oriented  stream 
delivery,  or  nonguaranteed  "best  effort"  connectionless  datagram  delivery.  Interface 
details  may  vary  between  operating  systems  but  socket  syntax  remains  compatible  and 
reasonably  consistent  on  a  variety  of  platfonns. 

Sockets  originated  with  the  Unix  operating  system  as  a  way  to  make  network 
communications  syntactically  similar  to  input/output,  file  and  other  stream  operations. 
Implementing  a  connection-oriented  socket  usually  requires  three  stages:  open, 
read/write  and  close.  Such  socket  use  is  not  symmetric  since  sockets  follow  a 
client/server  paradigm,  where  the  server  first  opens  a  port  and  then  waits  for  a  client 
process  to  connect  so  that  reliable  two-way  communication  can  begin.  Normally 
sockets  are  used  point  to  point  between  paired  processes,  such  as  tightly-coupled 
distributed  virtual  world  components. 

Connectionless  sockets  differ  in  that  the  ultimate  destination  address  of  the  client 
need  not  be  known  by  the  server,  with  a  corresponding  lack  of  error  detection  and 
error  recovery  procedures  to  ensure  reliable  delivery.  •  A  connectionless  approach  is 
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preferred  when  the  data  stream  is  continuous  or  in  real  time,  since  subsequent  packets 
will  automatically  supersede  and  replace  previous  lost  packets. 

Broadcast  protocols  for  socket  communication  are  sometimes  used  for 
multiple-entity  interaction.  However  such  use  is  usually  unacceptable  due  to 
indi.scriminate  consumption  of  bandwidth  and  unnecessary  demand  on  processor 
cycles.  The  limitations  of  broadcast  are  the  principal  reasons  for  the  current 
bottleneck  in  simultaneous  communications  among  many  entities.  By  way  of  analogy, 
consider  the  possibility  that  you  were  able  to  hear  (and  had  to  simultaneously  listen  to) 
every  person  speaking  in  the  building  where  you  work.  It  would  be  impossible  to 
carry  on  any  type  of  conversation  since  your  ability  to  di.scriminate  between  speakers 
and  words  would  be  completely  overwhelmed.  A  similar  scenario  occurs  when  large 
numbers  of  processes  communicate  indiscriminately  via  broadcast  protocols:  every 
process  must  receive  and  interpret  every  communication  at  the  highest  layers  of  the  IP 
stuck,  and  voluminous  entity  traffic  produces  a  computational  load  that  can  eventually 
overwhelm  processor  capacity.  Occasionally  broadcast  can  be  useful  on  a  dedicated 
local  area  network  among  specific  virtual  world  components,  or  among  a  limited 
number  (dozens  or  perhaps  a  few  hundreds)  of  entities.  For  large  entity  populations,  it 
is  necessary  to  avoid  broadcast  protocols  and  instead  utilize  multicast  protocols,  in 
order  to  logically  partition  the  communication  space  and  eliminate  unnecessary 
interactions  (Macedonia  94b). 

F.  MULTICAST  PROTOCOLS  AND  THE  MULTICAST  BACKBONE 

(MBone) 

IP  multicasting  is  the  transmission  of  IP  datagrams  to  an  unlimited  number  of 
multicast-capable  hosts  which  are  connected  by  multicast-capable  routers.  Multicast 
groups  are  specified  by  unique  IP  Class  D  addresses,  which  are  identified  by  1 1  lOj  in 
the  high-order  bits  and  correspond  to  Internet  addresses  224.0.0.0  through 
239.255.255.255.  Hosts  choose  to  join  or  leave  multicast  groups  and  subsequently 
inform  routers  of  their  membership  statu.s.  Of  great  significance  is  the  fact  that 
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individual  hosts  control  which  multicast  groups  they  monitor  by  reconfiguring  their 
network  interface  hardware  at  the  data  link  layer.  Since  datagrams  from  unsubscribed 
groups  are  ignored  at  the  hardware  interface,  host  computers  can  solely  monitor  and 
process  packets  from  groups  of  interest,  remaining  unburdened  by  other  network  traffic 
(Comer  91)  (Deering  89). 

Multicasting  has  existed  for  several  years  on  local  area  networks  such  as 
Ethernet  and  Fiber  Distributed  Data  Interface  (FDDI).  However,  with  Internet 
Protocol  multicast  addressing  at  the  network  layer,  group  coinmunication  can  be 
established  across  the  Internet.  Since  multicast  streams  are  typically  connectionless 
UDP  datagrams,  there  is  no  guaranteed  delivery  and  lost  packets  stay  lost.  This 
best-effort  unreliable  delivery  behavior  is  actually  desirable  when  streams  are  high 
bandwidth  and  frequently  recurring,  in  order  to  prevent  network  congestion  and  packet 
collisions.  Example  multicast  streams  include  video,  graphics,  audio  and  DIS. 

The  ability  of  a  single  multicast  packet  to  connect  with  every  host  on  a  local 
area  network  is  good  since  it  minimizes  the  overall  bandwidth  needed  for  large-scale 
communication.  Note  however  that  the  same  multicast  packet  is  ordinarily  prevented 
from  crossing  network  boundaries  such  as  routers.  If  a  multicast  stream  that  can  touch 
every  workstation  were  able  to  jump  from  network  to  network  without  restriction, 
topological  loops  might  cause  the  entire  Internet  to  become  saturated  by  such  streams. 
Routing  controls  are  necessary  to  prevent  such  a  disaster,  and  are  provided  by  the 
recommended  multicast  standard  (Deering  89)  and  other  experimental  stan'^ards. 
Collectively  the  resulting  internetwork  of  communicating  multicast  networks  is  called 
the  Multicast  Backbone  (MBone). 

The  MBone  is  a  Virtual  network  since  it  shares  the  same  physical  media  as  the 
internet.  A  specially  configured  set  of  multicast-capable  routers  (mrouters)  enables 
multicast  packets  to  reach  networks  that  have  ananged  for  multicast  connectivity. 
These  mrouters  can  be  upgraded  commercial  routers,  or  dedicated  workstations 
running  with  modified  kernels  in  parallel  with  standard  routers.  They  are  augmented 
by  "tunneling,"  a  scheme  to  encapsulate  and  forward  multicast  packets  among  the 
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islands  of  MBone  subnets  through  Internet  IP  routers  that  do  not  yet  support  IP 
multicast.  The  net  effect  of  each  routing  scheme  is  identical  for  end  users  and 
applications:  they  can  send  and  receive  continuous  multicast  data  streams  throughout 
the  MBone,  and  thus  most  of  the  Internet. 

The  MBone  contiols  multicast  packet  distribution  across  the  Internet  in  two 
ways:  multicast  packet  hops  through  routers  can  be  limited  at  the  source  using  an 
attached  time-to-live  parameter,  and  sophisticated  experimental  mrouter  pruning 
algorithms  can  adaptively  restrict  multicast  transmission.  Network  administrators  can 
also  logically  constrain  the  threshold  capacity  of  multicast  routes  to  avoid  overloading 
physical  link  capacity.  Multicast  packet  truncation  is  performed  by  decrementing  the 
time-to-live  (ttl)  field  each  time  the  packet  passes  though  an  mrouter.  A  ttl  value  of 
16  might  logically  limit  a  multicast  stream  to  a  campus,  as  opposed  to  values  of  127 
or  255  which  might  send  a  multicast  stream  to  every  subnet  on  the  MBone  (currently 
about  15  countries).  A  ttl  field  is  sometimes  decremented  by  large  values  under  a 
global  thresholding  scheme  provided  to  limit  multicasts  to  sites  and  regions  if  desired. 

Improved  real-time  delivery  schemes  are  also  being  evaluated  using  the 
Real-time  Transport  Protocol  (RTP)  which  is  eventually  expected  to  work 
independently  of  TCP  and  UDP  (Schulzrinne  93).  Other  real-time  protocols  are  also 
under  development.  The  end  result  available  today  is  that  even  with  a  time-critical 
application  such  as  an  audio  tool,  participants  normally  perceive  conversations  as  if 
they  are  in  ordinary  real  time.  This  behavior  is  possible  because  there  is  actually  a 
small  buffering  delay  to  synchronize  and  resequence  the  arriving  voice  packets. 
Research  efforts  on  real-time  protocols  and  numerous  related  issues  are  ongoing,  since 
every  bottleneck  conqu'ered  results  in  a  new  bottleneck  revealed. 

The  MBone  community  must  manage  the  MBone  topology  and  the  scheduling  of 
multicast  sessions  to  minimize  congestion.  Currently  over  1500  subnets  are  connected 
worldwide.  Topology  changes  for  new  nodes  are  added  by  consensus:  a  new  site 
announces  itself  to  the  MBone  mail  list,  and  the  nearest  potential  providers  decide  who 
can  establish  the  most  logical  connection  path  to  minimize  regional  Internet  loading. 
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Scheduling  MBone  events  is  handled  similarly.  Special  programs  are  announced  in 
advance  on  an  electronic  mail  list.  Advance  announcements  usually  prevent 
overloaded  scheduling  of  Internet-wide  events  and  alert  potential  participants. 
Cooperation  is  key.  Newcomers  are  often  surprised  to  learn  that  no  single  person  or 
authority  is  "in  charge"  of  either  topology  changes  or  event  scheduling.  Figure  7.3 
shows  a  typical  session  directory  (sd)  list  of  programs  available  on  the  MBone. 


Figure  7,3  Session  directory'  (sd)  programs  available  on  the  MBone. 

Note  DIS  packets  for  NFS  AUV  Underwater  Virtual  World  are  sent 
over  the  whiteboard  address  (orientation:  dis-auv-uvw). 


Note  session  specifications  in  the  advertisement  window  arc  used  to  automatically 
launch  and  connect  video,  audio,  whiteboard,  and  DIS-cornpatible  graphics  viewer 
applications. 

The  MBone  community  is  active  and  open.  Work  on  tools,  protocols,  standards, 
applications,  and  events  is  very  much  a  cooperative  and  international  effort.  Such 
cooperation  is  essential  due  to  the  limited  bandwidth  of  many  networks,  particularly 
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transoceanic  links.  So  far,  no  hierarchical  .scherre  has  been  necessary  for  resolving 
potentially  contentious  issues  such  as  topology  changes  or  event  scheduling. 
Intere.stingly,  distributed  problem  solving  and  decision  making  has  worked  on  a  human 
level  just  as  successfully  as  on  the  network  protocol  level.  Hopefully  this 
decentralized  approach  will  continue  to  be  successful,  even  with  the  rapid  addition  of 
new  users  (Macedonia,  Brutzman  94). 

(,.  DISTRIBUTED  INTERACTIVE  SIMULATION  (DIS)  PROTOCOL 

USAGE 

The  Distributed  Interactive  Simulation  (DIS)  protocol  is  an.  IEEE  standard  for 
communication  among  entities  in  distributed  simulations  (IEEE  93,  94a,  94b). 

Although  initial  development  was  driven  by  the  needs  of  military  users,  the  protocol 
formally  specifies  the  communication  of  physical  interactions  by  any  type  of  physical 
entity  and  is  well-suited  for  general  use.  Information  is  exchanged  using  protocol  data 
units  (PDUs)  which  are  defined  for  a  large  number  of  interaction  types. 

Multicast  and  broadcast  DIS  implementations  are  freely  available  and  have  been 
successfully  utilized  in  real-time  virtual  battlefield  exercises  containing  hundreds  of 
active  human  and  autonomous  entities  (Zeswitz  93)  (Pratt  93,  94a)  (Zyda  93b). 
Exploiting  the  features  of  multicast  to  logically  partition  DIS  interactions  in  a  manner 
similar'  to  real  world  interactions  is  expected  to  permit  scaling  up  virtual  worlds  to 
include  10,000  or  more  players  (Macedonia  95a,  95b,  95c). 

The  principal  PDU  type  is  the  Entity  State  PDU.  This  PDU  encapsulates  the 
position  and  posture  of  a  given  entity  at  a  given  time,  along  with  linear  and  angular 
velocities  and  accelerations.  Special  components  of  an  entity  such  as  the  orientation 
of  moving  parts  can  also  be  included  in  the  PDU  as  articulated  parameters.  A  full  set 
of  identifying  characteristics  can  uniquely  and  completely  specify  the  originating 
entity.  A  variety  of  dead  reckoning  algorithms  permits  computationally  efficient 
projection  of  entity  posture  by  listening  hosts.  Several  dozen  additional  PDU  types  are 
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also  defined  for  simulation  management,  sensor  or  weapon  interaction,  signals,  radio 
communications,  collision  detection  and  logistics  support. 

Of  particular  interest  to  virtual  world  designers  is  an  optionally-addressable  open 
format  message  PDU  type.  Message  PDUs  allow  user-specified  extensions  to  the  DIS 
standard.  Such  flexibility  coupled  with  the  efficiency  of  Internet-wide  multicast 
delivery  permits  extension  of  the  object-oriented  message-passing  paradigm  to  a 
disuibuted  system  of  essentially  unlimited  scale.  Of  related  interest  is  ongoing 
re.search  by  the  Linda  project  into  the  use  of  "tuples"  as  the  communications  unit  for 
logical  entity  interaction  (Gelernter  92a,  92b)  (Caniero  90).  It  is  reasonable  to  expect 
that  free-format  DIS  message  PDUs  might  also  provide  remote  distributed  connectivity 
resembling  that  of  tuples  to  any  infoimation  site  on  the  Internet,  further  extended  by 
using  mechanisms  which  already  exist  for  the  V/orld-Wide  Web.  This  is  a  promising 
area  for  future  work. 

H.  INTERNET- WIDE  DISTRIBUTED  HYPERMEDIA  VIA  THE 

WORLD-WIDE  WEB  (WWW) 

The  World-Wide  Web  (WWW)  project  has  been  defined  as  a  "wide-area 
hypermedia  information  retrieval  initiative  aiming  to  give  universal  access  to  a  large 
universe  of  documents"  (Hughes  94).  Fundamentally  the  WWW  combines  a  name 
space  consisting  of  any  information  store  available  on  the  Internet  with  a  broad  set  of 
retrieval  clients  and  servers,  all  of  which  can  be  connected  by  easily-defined  hypertext 
markup  language  (.html)  multimedia  links.  This  globally-accessible  combination  of 
media,  client  programs,  servers  and  hyperlinks  can  be  conveniently  utilized  by  humans 
or  autonomous  entities.  The  Web  has  fundamentally  shifted  the  nature  of  information 
storage,  access  and  retrieval  (Beinei'S-Lee  94a,  94b)  (Hughes  94)  (Vetter  94). 

Universal  Resource  Locators  (URLs)  are  a  key  WWW  innovation  (Figure  7.4). 

A  block  of  information  might  contain  text,  document,  image,  sound  clip,  video  clip, 
executable  program,  archived  dataset  or  arbitrary  stream.  If  that  block  of  information 
exists  on  the  Internet,  it  can  be  uniquely  identified  by  host  machine  IP  address. 
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ftp://taurus.  cs.  nps.  navy,  mil/pub/auv/auv.  html 


Internet  host  name  or  number  filename  witli 

extension  for 

\  MIME  media 

^  j  type 

remote  server  connection  type  publicly 
(e.g.  http,  gopher,  ftp,  telnet  etc.)  accessible 

subdirectory 

Figure  7.4,  Example  Universal  Resource  Locator  (URL)  components. 

publicly  visible  local  directory,  local  file  name,  and  type  of  client  needed  for  retrieval 
(such  as  anonymous  ftp,  hypertext  browser  or  gopher).  Ordinarily  the  local  file  name 
also  includes  an  extension  which  identifies  the  media  type  (such  as  .ps  for  PostScript 
file  or  .fgb  for  an  image).  File  type  extensions  are  ordinarily  specified  by 
Multipurpose  Internet  Mail  Extensions  (MIME)  (Borenstein  93).  Thus  the  URL 
completely  specifies  everything  needed  to  retrieve  any  type  of  electronic  information 
resource.  Example  URLs  appear  in  the  list  of  references,  e.g.  (Hughes  94). 

If  one  considers  the  evolving  nature  of  the  global  information  infrastructure,  it  is 
clear  that  there  is  no  shortage  of  basic  information.  Quite  the  opposite  is  true.  Merely 
by  reading  the  New  York  Times  daily,  any  individual  can  have  more  information  about 
the  world  than  was  available  to  any  world  leader  throughout  most  of  human  history! 
Multiply  that  single  information  stream  by  the  millions  of  other  information  sources 
becoming  openly  available  on  the  Internet,  and  it  is  clear  that  we  do  not  lack  content. 
Mountains  of  content  have  become  accessible.  What  is  needed  now  is  context,  some 
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way  to  lociite  and  retrieve  related  pieces  of  information  or  knowledge  that  a  user  needs 
in  a  timely  fashion. 

The  World-Wide  Web  provides  an  open  and  easy  way  for  any  individual  to 
provide  context  for  the  mass  of  content  available  on  the  Internet.  For  virtual  world 
designers  this  is  a  particularly  inviting  capability.  Virtual  worlds  are  intended  to 
model  or  extend  the  real  world  {Zyda  93a).  Access  to  any  media  available  world-wide 
can  now  be  embedded  in  virtual  worlds,  enabling  much  greater  realism  and  timeliness 
for  virtual  world  inputs. 

What  about  scaling  up?  Fortunately  there  already  exists  a  model  for  this 
growing  mountain  of  information  content:  the  real  world.  Virtual  worlds  can  address 
the  context  issue  by  providing  information  links  similar  to  those  that  exist  in  our 
understanding  of  the  real  world.  Furthermore,  the  structure  and  scope  of  a  virtual 
world  relationships  can  be  dynamicly  extended  by  passing  WWW  references  over 
multicast  network  channels  (e.g.  as  a  DIS  message  PDU).  This  efficient  distribution 
of  information  lets  any  remote  user  or  component  in  a  virtual  world  participate  and 
interact  in  increasingly  meaningful  ways. 

Extensions  to  the  World-Wide  Web  to  support  globally  distributed  virtual  reality 
and  virtual  world  functionality  are  the  subject  of  active  investigation  (Pesce  94).  A 
Virtual  Reality  Modeling  Language  (VRML)  specification  and  implementation  is  being 
developed  by  a  large  and  informal  working  group  (Bell  94).  This  group  hopes  to 
produce  public  browsers  for  the  exploration  of  easily  and  consistently  defined  virtual 
worlds.  The  key  components  of  VRML  are  likely  to  be  a  scene  description  language 
(e.g.  modified  Open  Inventor  file  format),  existing  World-Wide  Web  functionality 
(e.g.  .html),  and  entity  ‘behavior  descriptions  (e.g.  Open  Inventor  engines),  augmented 
by  multicast  communications  (e.g.  MBone)  and  active  entity  interaction  protocols 
(e.g.  DIS). 
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I.  NETWORK  APPLICATION  IMPLEMENTATION  EXAMPLES 

Examples  of  the  networked  communication  methods  discussed  here  have  been 
implemented  in  a  distributed  underwater  virtual  world,  designed  to  support  a  single 
networked  autonomous  underwater  robot  while  periTiitting  any  number  of  human 
observers.  Remote  participants  use  3D  real-time  interactive  computer  graphics  as  a 
window  into  the  underwater  virtual  world.  Robot  to  virtual  world  communications  are 
performed  using  a  reliable  stream  socket.  Tfie  virtual  world  provides  real-time 
physically-based  modeling  of  six  degree-of-freedom  vehicle  hydrodynamics  and  sonar. 
Vehicle  position  and  posture  are  output  using  multicast  DIS  2.0.3  entity  state  PDUs. 
Remote  graphics  viewers  can  receive  PDUs  from  any  location  on  the  MBone  to  render 
robot  motion  and  virtual  world  interaction,  again  in  real  time,  seen  from  whatever 
viewpoint  each  individual  user  might  choose.  Graphics  windows  and  audio  can  also 
be  multicast  using  standard  MBone  video  and  voice  applications.  A  diagram  of  virtual 
world  communication  flows  appears  in  Figure  7.5. 

On  the  fly  text-to-speech  data  sonification  is  provided  using  a  WWW  client 
which  relays  mission  script  commands  to  a  sound  server  in  the  Netherlands 
(Belinfante  94).  That  remote  sound  server  parses  arbitrary  text  strings  into  phonemes 
and  then  generates  a  corresponding  audio  file,  which  is  returned  to  the  virtual  world 
for  local  play.  Text-to-speech  sound  queries  are  played  and  saved  locally  using  a 
filename  matching  the  original  text,  ensuring  that  network  bandwidth  consumption  is 
minimized  during  repetitive  queries. 

A  WWW  home  page  provides  free  access  to  source  code,  binary  executable 
programs,  installation  and  help  guides,  reference  papers  and  pertinent  images  to 
anyone  with  Internet  access  (Brutzman  94a,  94b,  94e).  Modifications  to  the  standard 
MBone  session  directory  configuration  file  are  also  provided  which  enable  remote 
MBone  users  to  participate  using  the  graphics  viewer,  DIS  communications,  default 
video  stream,  virtual  world  audio  output  and  Mosaic  display  of  the  virtual  world  home 
page.  All  of  these  applications  can  be  launched  in  concert  with  the  click  of  a  single 
button  on  the  MBone  session  directory.  As  participation  in  remote  virtual  worlds 
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Figure  7.5.  Distributed  communications  in  NPS  AUV  Underwater  Virtual  World. 
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approaches  the  ease  of  use  of  a  telephone,  collaboration  and  participation  in  computer 
graphics-enhanced  virtual  worlds  are  expected  to  grow  dramatically 
(Brutzman  y4c,  y4d)  (Rhyne  94). 

It  is  perhaps  startling  to  hear  someone  say,  "Here  is  an  interactive  multimedia 
television  station  that  you  can  use  to  send  out  computer  graphics  and  virtual  world 
interactions  between  your  desktop  and  the  world."  These  are  powerful  concepts  and 
powerful  tools  that  extend  our  ability  to  communicate  and  collaborate  tremendously, 

J.  SUMMARY  AND  FUTURE  WORK 

Four  network  components  are  proposed  as  being  sufficient  for  global-distributed 
virtual  world  networking:  sockets,  multicast  communications  protocols,  the 
Distributed  Interactive  Simulation  (DIS)  protocol  and  World-Wide  Web  connectivity. 
Sockets  aie  best  used  for  direct  communication  among  tightly-coupled  virtual  world 
components  and  not  for  participants.  Multicast  protocols  and  the  MBone  provide 
efficient  Internet-wide  distribution  of  graphics,  video,  audio  and  DIS  entity  state 
information  in  a  way  that  permits  scaling  up  to  very  large  numbers  of  active 
participants.  DIS  provides  well-defined  and  standardized  ways  for  physical  interaction 
communications  among  multiple  distributed  entities  in  real  time.  The  World-Wide 
Web  enables  virtual  worlds  to  utilize  as  much  of  the  real  world  as  can  be  connected  to 
the  Internet,  both  as  inputs  and  outputs. 

A  myriad  of  opportunities  previously  considered  impossible  are  now  becoming 
accessible.  MBone,  DIS  and  the  World-Wide  Web  are  changing  the  fundamental 
nature  of  the  Internet.  A  distributed  approach  works  both  on  a  human  level  and  a 
technical  level.  Scientific  collaboration,  shared  experiences,  simulation,  training, 
education,  virtual  environments,  high-bandwidth  networked  graphics,  remote  presence 
and  telerobotics  are  all  affected  by  these  capabilities.  Implementation  (  f  these 
concepts  in  an  underwater  virtual  world  has  demonstrated  their  feasibility  and  value. 

Open  access  to  any  type  of  live  or  archived  information  resource  is  available  for 
use  by  individuals,  programs,  collaborative  groups  and  even  robots.  Virtual  worlds  are 
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a  natural  way  to  provide  order  and  context  to  these  massive  amounts  of  information. 
World-wide  collaboration  works,  both  for  people  and  machines.  Finally,  the  network 
is  more  than  a  computer,  and  even  more  than  your  computer.  The  network  becomes 
our  computer  as  we  learn  how  to  share  resources,  collaborate  and  interact  on  a  global 
scale. 
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VIII.  SONAR  MODELING  AND  VISUALIZATION 


A.  INTRODUCTION 

This  chapter  describes  the  role  of  sonai’  modeling  and  sonar  visualization  in  an 
underwater  virtual  world.  The  potentially  significant  effects  of  sound  speed  profile 
(SSP)  on  sound  ray  paths  in  the  ocean  are  briefly  examined,  and  example  SSP  plots 
are  pre.sented  showing  component  measurements  and  possible  ray  path  variations. 
Differences  in  .sensor  modalities  and  difficulties  in  forming  mental  models  provide 
motivation  for  utilizing  scientific  visualization  techniques  to  graphically  render  sonar. 
The  necessity  for  a  real-time  sonar  model  makes  the  RRA  algorithm  (Ziomek  93,  94) 
appear  to  be  a  desirable  choice  based  on  offline  results.  Since  short-range  models  are 
the  most  time-critical  sonai'  application,  an  example  geometric  sonar  model  is 
presented  for  the  NPS  AUV  test  tank.  A  discussion  of  sonar  parameter  and  graphics 
rendering  considerations  for  sonar  visualization  is  presented  along  with  preliminary 
rendering  examples.  A  great  deal  of  important  future  work  is  possible  in  this  area. 

B.  SOUND  SPEED  PROFILE  (SSP) 

The  behavior  of  sound  waves  in  the  ocean  is  highly  variable.  Sound  waves 
"bend"  as  they  travel,  away  from  the  direction  of  higher  sound  speed  and  toward  the 
direction  of  lower  sound  speed.  This  is  an  example  of  Snell’s  Law  within  a 
continuously  varying  medium.  Since  this  bending  may  cause  significant  sound  wave 
path  changes,  and  since  it  does  not  occur  uniformly  over  a  wave  front,  the  travel  of 
sound  through  the  ocean  is  highly  nonlinear. 

The  primary  factor  influencing  sound  path  is  the  sound  speed  profile  (SSP). 
Water  depth  and  bottom  type  can  also  have  significant  effects.  Descriptions  of  SSP, 
water  depth  and  bottom  type  effects  on  sound  propagation  are  described  in  detail  in 
(Etter  91)  (Urick  83).  Sound  may  be  bent  towards  the  bottom  or  surface,  reflect  off 
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bottom  or  surface,  be  masked  at  certain  depths  by  "shadow  zones,"  travel  for  long 
ranges  via  convergence  zones,  or  remain  trapped  in  a  deep  sound  channel. 

The  many  ways  that  sound  can  travel  in  the  ocean  is  highly  variable.  Assuming 
knowledge  of  local  bathymetry,  the  primary  information  needed  for  sonar  prediction  is 
the  SSP.  Three  factors  control  local  sound  speed;  salinity,  temperature  and  pressure. 
These  parameters  can  be  determined  by  measuring  conductivity,  temperature  and 
density  (each  versus  depth)  directly  in  the  water  column.  Empirical  formulas  have 
been  determined  which  utilize  conductivity,  temperature  and  density  to  calculate  sound 
speed.  Typical  SSP  datasets  are  noisy  and  highly  redundant,  and  large  SSPs  may  be 
subsampled,  smoothed  or  represented  by  polynomial  approximations  for  computational 
tractability,  Figure  X,  1  shows  a  typical  SSP  plot  taken  from  deep  water  in  Monterey 
Bay  in  September  iy9(>  along  with  component  conductivity,  temperature  and  density 
contributions  (Ro.senfeld  94).  Figure  Figure  8.2  shows  the  large  possible  variations  in 
effects  of  an  example  SSP  on  ray  paths,  calculated  by  the  RRA  algorithm  for  a  set  of 
rays  initially  separated  by  only  0.4°. 
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Figure  8.1  Representative  sound  speed  profile  (SSP)  plot.  Includes  component 

conductivity  (salinity),  temperature  and  density  (CTD)  data  plots 
(Rosenfeld  93). 
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Figure  8.2.  Example  Recursive  Ray  Acoustics  (RRA)  algorithm  plot  showing 

sound  ray  bending  due  to  sound  speed  profile  (SSP)  and  bathymetry. 
Initial  vertical  orientation  difference  between  rays  is  only  0.4° 
(Ziomek  93). 


C.  MENTAL  MODELS  AND  SCIENTIFIC  VISUALIZATION 

CONSIDERATIONS 

The  modalities  of  sonar  sensing  are  much  different  from  that  of  vision.  For 
active  sonar,  ranges  are  measured  by  the  time  difference  between  pulse  transmission 
and  return  detection.  Multiplication  of  this  time  difference  by  the  speed  of  sound  in 
water  provides  a  very  accurate  range  estimate.  For  passive  sonar,  ranges  to  an  object 
producing  sound  are  not  directly  calculable  but  can  sometimes  be  deduced  by 
maneuvering  and  geometric  analysis.  For  both  active  and  passive  sonars,  bearings  are 
typically  accurate  only  within  a  few  degrees.  In  contrast,  vision  techniques  typically 
provide  very  accurate  bearings  with  approximate  ranges.  As  a  result,  perception 
algorithms  based  on  range  data  and  approximate  bearing  data  are  counterintuitive. 
Combined  with  the  complexity  of  .sound  travel,  it  is  difficult  for  individuals  to 
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visualize  and  conceptualize  underwater  sonar  effectively.  Sonar  operators  on 
submarines  typically  need  a  year  of  schooling  and  experience  to  qualify  before  their 
mental  models  become  sufficiently  familiar  to  permit  unsupeivised  watchstanding 
(Brutzman  93b). 

It  is  reasonably  conjectured  that  improved  sonar  visualization  can  dramatically 
improve  an  individual's  ability  to  understand  the  intricacies  of  sonai'  behavior.  It  is 
within  current  computational  capabilities  to  calculate  the  physical  path  taken  by  sound 
through  u  highly  variable  sonar  environment.  Rendering  the  results  using  3D 
computer  graphics  can  provide  useful  feedback  to  human  observers  regarding  sonar 
performance.  .Such  feedback  can  enable  the  production  of  effective  analysis  and 
classification  algorithms  suitable  for  real-time  autonomous  use  by  AUVs 
(Brutzman  92a,  92e)  (Compton  92). 

D.  REAL-TIME  SONAR  MODEL  RESPONSE  AND  THE 

RECURSIVE  RAY  ACOUSTICS  (RRA)  ALGOROHM 

As  previously  described  in  (Etter  91,  92)  a  great  variety  of  sonar  models  exist, 
but  unfortunately  most  are  restricted  to  highly  specific  environmental  domains. 
Additionally  most  sonar  models  are  computationally  expensive  and  are  thus  unsuitable 
for  real-time  performance.  Implementation  of  an  AUV  sonar  model  within  an 
underwater  virtual  world  requires  real-time  response.  Multiple  model  simultaneous 
real-time  respon.se  in  the  virtual  world  can  be  accomplished  through  distribution  on 
multiple  processors  if  necessary.  In  practice  at  a  10  Hz  rate,  multiple  processor 
distribution  has  not  been  necessary  for  the  core  models  interacting  directly  with  the 
AUV. 

Interestingly,  the  speed  of  sound  in  water  is  relatively  slow  (typically 
1650  yards/sec)  compared  to  the  speed  of  light  in  air.  For  active  sonars,  time  of  ping 
travel  corresponds  to  twice  the  range  to  target  plus  any  changes  due  to  ix-iative  vehicle 
motion.  This  implies  that  approximately  one  second  of  processing  time  can  be 
available  for  calculating  each  800  yards  of  active  sonar  travel.  Given  that  effective 
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sonar  ranges  can  be  10  miles  or  greater  in  distance,  a  great  deal  of  computer  time  may 
be  available  for  sonar  calculations  in  tactical  situations.  In  offline  experiments, 
implementations  of  the  RRA  algorithm  have  demonstrated  adequate  computational 
performiince.  It  is  expected  that  implementation  and  integration  of  the  RRA  algorithm 
as  an  online  model  for  active  or  pa.ssive  sonar  will  meet  all  underwater  virtual  world 
timing  requirements. 

M.  AN  EXAMPLE  (JEOMETRIC  SONAR  MODEL 

At  short  ranges,  timing  requirements  can  be  critical.  Fortunately  at  shorter 
ranges  the  effects  of  SSP  on  sound  wave  bending  are  negligible.  Rapid  calculation  of 
sonar  respons'  at  short  ranges  is  possible  through  application  of  computational 
geomeuy  techniques,  An  example  geometric  sonar  model  for  the  20  ft  by  20  ft 
NFS  AUV  test  tank  has  been  constructed  which  demonstrates  adequate  real-tune 
response  in  this  worst  case  scenai'io.  The  geometric  model  is  capable  of  10  Hz 
response  without  parallelization.  A  diagram  of  tank  geometry  appears  in  Figure  8.3. 

A  graphics  rendering  of  the  NPS  AUV  ST-1000  sonar  in  the  test  tank  as  calculated  by 
this  model  follows  in  Figure  8.4. 

The  following  formulae  are  used  to  calculate  the  coordinates  of  the  sonar  echo 
return  {R„  R^)  based  on  sonar  location  (S^,,  Sy)  and  sonar  orientation  The 

precede  Boolean  operator  (■<)  returns  TRUE  if  the  first  angle  precedes  the  second 
angle  by  less  than  1X0°,  expressed  algebraically  as  follows: 

{a  P)  2  {normalize2(P  -  a)  >  0}  (8.1) 

As  previously  defined  in  Chapter  IV,  normalize!  (angle)  normalizes  an  angle  to  the 
range  (-71/2.. 7C/2]. 

For  sonar-relative  quadrant  1  (SA  <  SB); 

(8.2) 
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Figure  8.3.  NFS  AUV  test  tank,  geometry. 


For  sonar-relative  quadrant  II  (SB  -<  xi/so„„  •<  SC); 


Ry  =  10 


For  .sonar-relative  quadrant  III  (SC  <  •<  SD): 


=S^  -sin(ilr^^-180»)(10+5,) 
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Figure  S.4.  Sonar  pointing  towards  test  tank  wall,  as  seen  from  behind  AUV. 


For  sonar-relative  quadrant  IV  (SD  -<  SA): 

Sonar  offset  coordinates  (S,,  S^)  can  be  calculated  from  vehicle 
coordinates  (V,,  V^)  using  vehicle  orientation  \|/  as  follows; 

~  ^  ^^longitudinal  soiuir  offset  ^ 


Sonar  range  is  determined  using  the  Pythagorean  theorem: 


sonar  range  =  +  {R^-Syf 


(8.7) 


Development  of  individual  geometric  models  for  the  large  variety  of  objects 
populating  a  virtual  world  can  be  prohibitively  laborious.  For  short  and  intermediate 
ranges,  this  problem  is  a  variation  of  the  virtual  world  collision  detection  problem 
which  is  solvable  in  real  time  for  tenain  and  hundreds  of  objects  (Pratt  93). 
Computationally  efficient  collision  detection  is  the  subject  of  active  research  for  larger 
worlds  (such  as  architectural  ship  design  models)  consisting  of  hundreds  of  thousands 
of  objects  (Zyda  93a).  In  an  underwater  environment  the  density  of  active  entities  is 
typically  sparse,  and  sonar  interactions  are  primarily  concerned  with  terrain  and  a 
relatively  small  number  of  mobile  entities.  Thus  geometric  model  switching 
corresponding  to  areas  of  interest  in  the  underwater  virtual  world  is  a  feasible 
approach. 

Interestingly,  graphics  toolkits  such  as  Open  Inventor  provide  mechanisms  for 
querying  the  ,scene  database  to  determine  ray  intersection  points  (Wernecke  94a). 
Conceivably,  the  same  scene  database  which  is  used  to  render  the  population  of 
objects  in  the  virtual  world  can  also  be  used  for  sonar  "collision"  detection,  perhaps 
independently  of  graphics  rendering.  This  is  a  promising  approach  for  automatic 
determination  of  sonar  detections  which  is  independent  of  the  geometry  of  individual 
objects  in  the  virtual  world.  Such  an  approach  is  also  highly  scalable  through 
reasonably  efficient  construction  or  optimization  of  scene  databases. 

F.  SONAR  RENDERING  FOR  VISUALIZATION 

Sonar  data  has  high  dimensionality  and  ordinarily  is  difficult  to  visualize. 
Scientific  visualization  methods  specialize  in  the  selective  application  of  various 
graphical  rendering  techniques  to  extract  the  maximum  possible  information  out  of 
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large  and  abstract  datasets  (Keller  93).  Scientific  visualization  is  therefore  a  direct 
example  of  a  guiding  precept  in  computer  science: 

The  purpose  of  computing  is  insight,  not  numbers.  (Hamming  86) 

A  great  many  possibilities  for  sonar  visualization  present  themselves.  A 
preliminai'y  consideration  of  sonar  parameters  and  computer  graphics  attributes  reveals 
a  large  number  of  relatively  orthogonal  characteristic  parameters  and  primitive 
rendering  operations.  They  are  listed  in  Figure  8.5.  Key  criteria  when  rendering  sonar 


Sonar  Parameters 

Rendering  Techniques 

sound  pressure  level  (SPL) 

color  variations 

depth 

intensity 

absolute  range  of  travel 

transparency 

downstream  horizontal  range 

illumination 

slant  range 

directional  lights 

signal  excess  for  detection 

individual  rays 

phase 

wave  fronts  versus  ray  groups 

pitch  angle 

density  of  ray  bundles 

target  intersection 

fog 

history  of  previous  returns 

animation 

SSP  variations  in  temperature, 

volume  visualization  techniques 

salinity,  pressure 

blur 

attenuation  by  absorption. 

data  smoothing 

scattering,  spreading 

data  enhancement/interpolation 

pulse  width 

data  sonification 

frequency  and  doppler  shift 

loading  and  modifying  images 

background  noise,  biologies, 
interference 

previously  rendered  offline 

Figure  8.5.  Preliminary  listing  of  orthogonal  sonai'  parameters  and  crthogonal 
computer  graphics  rendering  techniques  for  scientific  visualization. 

data  must  include  the  ability  to  focus  on  individual  parameters  of  tactical  interest, 
matching  orthogonal  parameters  to  rendering  techniques  which  are  not  mutually 
interfering,  real-time  response  corresponding  to  short  or  long  sonar  ranges,  animation 


of  spatial  or  temporal  changes,  and  selectable  user  control  of  either  visualization 
primitives  or  sonai"  parameters  of  interest. 

As  a  rudimentary  example  of  sonar-related  visualization,  a  rendering  of  SSP  data 
appears  in  Figure  8.6.  Formal  application  of  scientific  visualization  techniques  to 
sonar  rendering  is  a  promising  topic  for  future  work.  It  is  likely  that  best  results  will 
be  obtained  by  using  sonar  data  structures  which  are  equally  suitable  for  online 
representation  in  the  virtual  world  and  offline  rendering  using  visualization  toolkits. 

(,.  SUMMARY  AND  FUTURE  WORK 

Sonar  modeling  and  sonar  visualization  are  crucial  components  in  an  underwater 
virtual  world  for  an  autonomous  underwater  vehicle.  Accurate  real-time  sonar 
modeling  is  necessary  to  produce  realistic  sensor  interactions  with  the  vehicle. 
Visualization  is  necessai'y  for  robot  designers  to  create  mental  models  of  the  often 
counterintuitive  performance  of  sonar  in  highly  variable  ocean  environments.  Such 
mental  models  are  of  proven  benefit  when  designing  and  evaluating  robot  sensing 
algorithms.  SSP  effects  and  an  example  geometric  sonar  model  are  also  examined. 

Prtimising  areas  for  future  work  ai'e  dependent  on  successful  incorporation  of  a 
general  sonar  model  (or  models)  into  the  underwater  virtual  world.  The 
RRA  algorithm  shows  strong  potential  for  rapid  and  accurate  generation  of  sonar  rays 
in  real  time.  Additional  work  includes  the  formal  use  of  scientific  visualization 
techniques  to  match  up  typically  orthogonal  properties  of  sonar  response  to  typically 
orthogonal  rendering  methods.  It  is  expected  that  user  control  of  parameters  and 
combined  offline/cnline  algorithm  analysis  will  be  necessary  for  best  results. 
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Figure  8.6.  Example  graphics  visualization  of  subsampled  Sound  Speed  Profile 
(SSP).  Sound  speed  is  mapped  to  cylinder  color  at  inteivals 
proportional  to  local  depth,  producing  a  3D  information  icon. 
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IX.  EXPERIMENTAL  RESULTS 


A.  INTRODUCTION 

Experiineiital  testing  is  essential  to  producing  realistic  response  in  a  virtual 
world.  Real  world  behavior  can  be  predicted  and  analyzed  in  the  laboratory  by 
running  tests  which  exercise  all  vehicle  system.s.  and  by  reproducing  mission  scenarios 
which  are  used  in  the  real  world.  Since  no  such  thing  as  a' completely  benign  AUV 
test  environment  exists  in  the  real  world,  laboratory  virtual  world  testing  is  essential 
and  can  c  'ercome  impediments  associated  with  the  use  of  tethers  and  acoustic 
telemed-y.  Repeatability  of  results  and  statistical  co.'trol  of  sensor  eiTors  enable  tests 
and  machine  learning  algorithms  which  are  not  feasible  in  the  real  world.  Duplication 
of  at-sea  test  results  in  the  laboratory  can  serve  as  validation  of  virtual  world 
functionality,  at  least  as  is  seen  from  a  robot  perspective. 

An  extended  laboratory  test  mission  is  examined  to  illustrate  how  hydrodynamics 
respci'se  is  highly  complex  and  requires  detailed  analysis.  Network  response  is  also 
evaluated  for  sevetal  experiments  that  utilized  the  Internet-wide  Multicast  Backbone 
ivlBone).  Network  parameters  of  greatest  interest  are  temporal  laten  .y,  bandwidth 
■equirenients,  and  suitability  for  large-.scale  distributed  simulation. 

B.  PREDICTING  AND  ANALYZING  REAL-WORLD  BEHAVIOR  IN  THE 

LABORATORY 

The  key  to  producing  reliable  robot  software  is  repeated  testing.  There  are  many 
reasons  why  risk-free  end-to-end  testing  of  all  systems  aboard  an  AUV  is  rarely 
possible.  Leaks  can  occur  in  shallow  or  deep  water.  Vehicle  hydrodynamics  response 
is  complex  and  is  also  crucial  to  understanding  physical  behavior.  The  many  effects 
involved  in  underwater  motion  make  accui'ate  posture  re.sponse  an  essential 
prerequisite  for  meaningful  testing  of  vehicle  control  algorithms  and  intelligent  control 
architectures.  Underwater  vehicles  contain  too  many  fragile  components  to  "navigate 
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by  collision"  as  some  indoor  robots  do.  Underwater  sonar  range  sensors  do  not 
operate  in  air.  Underwater  vehicles  are  usually  very  heavy,  and  test  stand  mountings 
with  multiple  degrees  of  freedom  are  impractical. 

Repeated  testing  using  a  tether  for  remote  monitoring  and  emergency 
intervention  is  an  effective  test  technique  when  preparing  for  open-ocean  autonomous 
missions  (Brancart  94)  (Pappas  91).  Unfortunately  tethers  induce  significant  drag 
effects,  and  tether  management  either  requires  very  expensive  tether  control  systems  or 
continuous  human  supervision.  Acoustic  telemetry  can  free  the  vehicle  from  these 
impediments,  but  acoustic  communications  are  always  prey  to  intermittent  loss  due  to 
factors  such  as  multipath  arrival,  masking,  attenuation,  and  sound  wave  propagation 
away  from  source  or  receiver.  Deployment  and  recovery  of  vehicles  in  the  water  is 
always  costly  and  time-consuming,  limiting  the  scope  of  test  programs.  In-water 
results  are  usually  nonrepeatable  due  to  changing  conditions  or  lack  of  time.  This 
inability  to  reliably  repeat  tests  on  demand  greatly  complicates  software  engineering 
tusks  such  as  debugging,  algorithm  tuning,  and  logic  verification. 

Laboratory  testing  using  a  virtual  world  can  produce  repeatable  results  that  are 
based  on  realistic  hydrodynamics  response  and  realistic  sonar  predictions.  Laboratory 
tests  can  attempt  to  replicate  in-water  results  as  a  means  of  tuning  models  to  more 
accurately  represent  the  real  world.  Since  a  virtual  world  includes  everything  normally 
detectable  by  the  robot  in  the  real  world,  a  virtual  world  can  be  validated  by  identical 
robot  operation  in  identical  scenarios  in  either  world.  In  a  sense  this  seiwes  as  a  kind 
of  Turing  test  for  the  virtual  world:  if  robot  operation  is  identical  in  the  real  world 
and  the  virtual  world,  then  the  virtual  world  is  functionally  equivalent  to  the  real 
world.  In  practice,  small  differences  aie  usually  expected  which  always  need  to  be  fed 
back  into  tuning  virtual  world  component  models  more  exactly.  Note  that  the 
sophistication  of  this  approach  will  likely  lead  to  more  rigorous  consideration  of 
interactions  among  multiple  models  which  is  impossible  using  standalone  simulations. 

As  vir  tual  world  component  models  become  more  reliable  and  robust,  vehicle 
deviations  from  predicted  behavior  in  the  real  world  will  be  less  frequent.  A  robot  can 
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be  programmed  to  recognize  and  measure  such  deviations,  eventually  automating  many 
details  regarding  model  eiTor  detection  and  coirection.  Embedding  vir'tual  world 
models  as  predictors  in  robot  control  logic  will  lead  to  robust  failure  diagnosis  and 
correction  schemes,  perhaps  coupled  with  machine  learning  techniques  for  greater 
generality. 

A  significant  advantage  of  laboratory  testing  over  real  v/orld  testing  is  the  ability 
to  eliminate  or  statistically  control  error  deviations  in  sensor  measurements.  Usually 
robot  designers  need  first  to  test  theii'  programs  under  perfect  conditions  to 
demonstrate  correctness,  and  then  test  again  under  error-prone  conditions  to 
demonstrate  robustness,  Setting  ernrr  distributions  of  sonars  or  inertial  measurement 
devices  permits  statistical  analysis  of  arbitrary  measures  of  effectiveness  (MOEs)  for 
large  numbers  of  replications.  Such  testing  is  useful  for  detennining  overall  system 
effectiveness  over  a  range  of  operating  conditions,  and  also  enables  machine  learning 
techniques  based  on  massive  repetitive  training. 

Validation  and  verification  of  underwater  virtual  world  models  for  dynamics  and 
sonar  needs  to  be  an  ongoing  part  of  any  AUV  research  and  development  program. 

The  complexity  and  subtlety  of  these  large  models  means  that  multiple  effects  may 
contribute  to  a  given  response,  and  any  change  to  a  hydrodynamic  coefficient  may 
ripple  through  the  model  with  unexpected  side  effects.  A  .set  of  standardized  vehicle 
missions  and  documented  responses  needs  to  be  duplicated  and  compared  in  the  virtual 
world  whenever  such  model  changes  occur.  This  process  also  is  a  likely  candidate  for 
automation  as  model  reliability  improves. 

Verification  Validation  and  Accreditation  (VV  &  A)  is  a  set  of  methodologies 
concerned  with  showin'g  that  simulation  models  are  comect  representations  of  reality. 
Some  key  terms  follow: 

•  Verification:  Substantiation  that  the  computer  program  implementation  of  a 
conceptual  model  is  correct  and  performs  as  intended.  (Kneppell  93) 
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•  Validation:  Substantiation  that  a  computer  model,  within  its  domain  of 
applicability,  possesses  a  satisfactory  range  of  accuracy  consistent  with  the 
intended  application  of  the  model.  (Kneppell  93) 

•  Accreditation:  official  determination  that  the  model  and  program  are  valid 
enough. 

Confidence  assessments  can  be  performed  to  assess  the  credibility  of  a 
simulation.  Detailed  methodologies  have  been  developed  for  conducting  such 
as.se.ssments  (Kneppel  93)  (Law,  Kelton  91).  All  a.spects  of  a  simulation  are  evaluated 
including  level  of  detail,  scope  of  intended  u.se,  fidelity,  granularity,  data  verification, 
constraining  assumptions  and  model  validity.  Concerns  .specific  to 
hardwarc-in-the-loop  simulations  include  timing  constraints,  information  exchange  and 
system  integration.  While  operational  tests  ai'e  considered  to  be  of  greatest  importance 
in  validation  and  verification,  overall  confidence  as.sessments  remain  a  value 
judgement  determined  by  extensive  evaluation  of  all  aspects  of  a  simulation.  As  with 
many  software  engineering  practices,  formal  approaches  to  verification  and  validation 
are  of  greatest  value  in  ensuring  correct  design  and  implementation.  Accreditation  is 
expected  to  be  a  future  issue  for  models  and  virtual  worlds  used  by  the 
U.S.  Department  of  Defense  (DoD),  but  current  accreditation  policies  are  immatuie 
and  nut  applicable  to  this  project.  Recoiiuiiended  future  work  for  this  and  other  virtual 
worlds  is  performance  of  a  formal  independent  validation  and  verification  confidence 
assessment  in  accordance  with  (Kneppel  93).  Such  an  assessment  might  uncover 
inadvertently-missing  virtual  world  component.s,  and  can  also  help  establish  a  rigorous 
theoretical  definition  of  the  formal  requirements  needed  fur  globally  networked 
large-.scale  virtual  worlds. 

C.  SIMULATION  RUN  ANALYSIS:  mission. s'cript.xiggraph 

A  great  number  of  execution  level  mission  scripts  have  been  developed  to  test 
the  many  facets  of  the  hydrodynamics  model.  There  is  a  rich  set  of  execution  level 
script  commands  available,  any  of  which  can  be  provided  via  command  file 
mission. script  or  by  the  user  via  keybuai'd.  The  execution  level  script  command 
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language  is  also  designed  to  serve  as  application  communications  protocol  between  the 
real-time  execution  level  and  supervising  tactical  level.  Syntax  of  the  script  command 
language  appears  in  (Brutzman  y4e).  In  general  these  simple  commands  are  similoi'  to 
those  which  might  be  given  by  a  diving  officer  on  a  submarine,  with  the  addition  of 
waypoint  following  and  hovering  behaviors. 

Comprehensive  analysis  of  numerous  detailed  hydrodynamics  variable  plots  is 
difficult  to  perform  but  remains  essential  when  verifying  quantitative  robot  and  model 
performance.  However,  intuitive  observation  and  qualitative  evaluation  of  missions  is 
not  possible  without  a  3D  real-time  graphics  viewer.  The  value  of  such  a  viewer 
cannot  be  overemphasized.  Subtle  (and  ocea.sionally  gross)  vehicle  events  are  often 
not  noticeable  on  the  telemetiy  plots  until  the  user  recognition  has  been  cued  by  the 
graphics  viewer.  In  most  work  on  hydrodynamics,  plots  are  the  only  way  to  formally 
evaluate  performance.  Plots  still  .serve  an  essential  function  in  qualitative  analysis,  but 
integration  of  a  live  3D  real-time  viewer  means  that  users  are  no  longer  required  to 
mentally  integrate  dozens  of  temporal  response  curves  while  attempting  to  visualize 
true  vehicle  behavior. 

The  most  cumi)rehensive  robot  hydrodynamics  test  provided  in  this  work  is  the 
"SIGGKAPH"  mission  file  (niission.srript.sij{^raph),  which  was  used  repeatedly  during 
the  presentation  of  the  underwater  virtual  world  at  the  SIGGRAPH  94  conference 
(Brutzman  94b).  3’he  mi.ssion  script  appears  in  Figure  9.1.  A  time  log  of  mission 
output  orders  appears  in  Figure  9.2.  Twenty  plots  examining  vehicle-environment 
hydrodynamic  interaction  follow  (Figure  9.3  through  Figure  9.22).  These  plots  are 
automatically  produced  from  robot  mi.ssion  telemcuy  and  can  be  generated  for  any 
robot  mission  (Brutzman  94e).  Essentially  tlrese  plots  show  the  temporal  relationships 
among  three  dozen  key  hydrodynamic  variables  throughout  a  mission.  A  large  number 
of  additional  test  missions  focused  on  specific  robot-environment  interactions  are 
provided  with  the  underwater  virtual  world  distribution  (Brutzman  94e).  The 
SIGGRAPH  mi.ssion  vehicle  behavior  plots  which  follow  have  been  manually  verified 
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using  hydrodynamics  coefficients  and  similar  test  results  produced  by  earlier 
NPS  AUV  hydrodynamics  theses  (Warner  91)  (Bahrke  92)  (Torsiello  94). 


206 


#  , , , , 

«  Hello  SIGGRAPH! 


«  This  is  a  mission 
script 

#  for  Che 

#  N  P  s  Autonomous 
Onderwater  Vehicle 
«  ,  , ,  , 

#  your  mission  is 

#  siggraph  test 

mission . script . siggraph 

III! 

#  we  are  having  some 
fun  I 

#  , , ,  , 

#  Graphics  rendering 
uses  Open  Inventor 

#  from  Silicon  Graphics 
,  ,  ,  S  G  I 

#  , ,  ,  , 

#  D  I  S  multicast 
version  203 

#  from  the 

#  Naval  Postgraduate 
School 

^  1 1 1  I 

#  initialize  vehicle 
position  000 
orientation  0  0  0 

#  reset  dynamics  clock 

time  0 

thrusters-on 

«  propellers  off 
rpm  0 

course  000 

depth  0 

wait  1 

«  going  deep 
tt  with  thrusters 
depth  45 

0  here  we  go! 
wait  20 


#  still  going  deep 
wait  20 

#  almost  there,  hang  on 
wait  25 

#  at  depth 

#  change  course 

course  090 
wait  10 

#  stabilizing  depth 

#  during  course  change 
wait  10 

#  lateral  thruster 
control 

lateral  2 

#  feet  per  second 

wait  3  seconds 

lateral  -2 

#  feet  per  second 

wait  3 

lateral  0 

#  no  more  lateral 
movement 

RUDDER  0 

heading  20 
wait  5 

#  propellers  on 

rpm  400 

wait  4 

#  aim  for  the  window 

course  OOS 

rpm  700 

wait  9 

#  building  up  speed 

course  000 

wait  11.3 

depth  48.2 

course  270 

wait  26 

course  180 

wait  10 

thrusters-of f 

#  going  shallow 

#  with  propellers 


depth  4 

wait  5 

#  vehicle  hydrodynamics 
are 

#  coupled  in  six  degrees 
of  freedom 

wait  5 

#  please  note  that 

#  vehicle  instability 

#  is  very  possible 

#  , , ,  / 

wait  10 

#  rudder  spiral 
rudder  -12 
wait  10 

#  wow  this  is  hard! 

#  <  /  /  / 

wait  10 

#  we  are  spiraling  up  to 
the  surface 

wait  23 

#  at  the  surface 

thrusters-on 
course  090 
wait  10 

#  moving  back  above  the 
pool 

wait  8 

#  we  are  now  stabilizing 
rpm  -700 

wait  10 

#  propellers  off 

rpm  0 

wait  10 

course  0 
hover  0  0  0 
wait  81.5 

wait  0.1 

#  A  u  V  is  stable  at 
origin 

#  time  to  restart 'the 
mission 

#  don't  forget  to  add 
your  e-mail  address 

#  mission  complete 
quit 


Figure  9.1.  Canonical  execution  level  mission  script:  mission.script. siggraph 
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«  NPS  AUV  file  mission. output. orders:  commanded  propulsion  orders  versus  time 
#  timestep:  0.10  seconds 


time 

heading 

North 

X 

East  Depth 

y  z 

rpm 

port 

rpm 

stbd 

stern 

plane 

stern 

rudder 

vertical 

thrusters 

bow/stern 

lateral 

thrusters 

bow/stern 

0.0 

6.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

.  0.0 

0.0 

0.0 

1.0 

0.0 

0.0 

0.0 

45.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

21.0 

0.0 

0.0 

0.0 

45.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

41.0 

0.0 

0.0 

0.0 

45.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

66.0 

90.0 

0.0 

0.0 

45.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

76.0 

90.0 

0.0 

0.0 

45.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

86.0 

90.0 

0.0 

0.0 

45.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

89.0 

90.0 

0.0 

0.0 

45.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

92.0 

20.0 

0.0 

0.0 

45.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

97.0 

20.0 

0.0 

0.0 

45.0 

400.0 

400.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

101.0 

5.0 

0.0 

0.0 

45.0 

700.0 

700.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

110.0 

0.0 

0.0 

0.0 

45.0 

700.0 

700.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

121.3 

270.0 

0.0 

0.0 

48.2 

700.0 

700.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

147.4 

180.0 

0.0 

0.0 

48.2 

700.0 

700.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

157.4 

180.0 

0.0 

0.0 

4.0 

700.0 

700.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

162.4 

180.0 

0.0 

0.0 

4.0 

700.0 

700.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

167.4 

180.0 

0.0 

0.0 

4.0 

700.0 

700.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

177.4 

180.0 

0.0 

0.0 

4.0 

700.0 

700.0 

-12.0 

0.0 

0.0 

0.0 

0.0 

0.0 

187.4 

180.0 

0.0 

0.0 

4,0 

700.0 

700.0 

-12.0 

0.0 

0.0 

0.0 

0.0 

0.0 

197.4 

180.0 

0.0 

0.0 

4,0 

700.0 

700.0 

-12.0 

0.0 

0.0 

0.0 

0.0 

0.0 

220.4 

90.0 

0.0 

0.0 

4.0 

700.0 

700.0 

-12.0 

0.0 

0.0 

0.0 

0,0 

0.0 

230.4 

90.0 

0.0 

0.0 

4.0 

700.0 

700.0 

-12.0 

0.0 

0.0 

0.0 

0.0 

0.0 

238.4 

90.0 

0.0 

0.0 

4.0 

-700.0 

-700.0 

-12.0 

0.0 

0.0 

0.0 

0.0 

0.0 

248.4 

90.0 

0.0 

0.0 

4.0 

0.0 

0.0 

-12.0 

0.0 

0.0 

0.0 

0.0 

0.0 

258.4 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

258.4 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0,0 

0.0 

0.0 

0.0 

0.0 

339.9 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0,0 

0.0 

0.0 

0.0 

0.0 

340.1 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

Figure  9.2.  Resulting  time  log  of  robot  mission  output  orders;  mission.output.orders 

An  event-by-event  analysis  of  the  SIGGRAPH  mission  follows  in  Table  9.1  to 
identify  key  relationships  and  results.  This  analytical  timeline  was  produced  by 
examining  the  original  mission  script  Figure  9.1,  the  condensed  mission  orders 
Figure  9.2  and  individual  hydrodynamics  plots  (Figure  9,3  through  Figure  9.22). 

t 

Finally  graphics  images  showing  vehicle  thrusters,  propellers  and  plane  surfaces 
operating  simultaneously  appear  in  Figure  9.23  and  Figure  9.24.  In  these  figures, 
green  wireframe  cones  are  proportional  to  the  thrust  of  sea  water  from  the  cross-body 
tlirusters  and  the  propellers. 
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Table  9.1.  Timeline  Analysis  of  SIGGRAPH  Mission. 


time 

mm:ss 

time 

sec 

Analytic  results,  ordered  robot  changes  and  pertinent  plots. 

{):()() 

0,0 

Initial  postal  '  at  origin  (0,  0,  0)  with  orientation  (0,  0,  0). 

0:01 

1,0 

Behavior  stab'e  and  unchanging  prior  to  first  order. 

Change  depth  to  45  ft  using  vertical  thrusters  only. 

Plots  4.  20,  10,  13,  20. 

1:16 

66.0 

At  ordered  depth,  heave  rate  stabilizing. 

Change  ordered  course  to  right  from  000°  to  090°  using  lateral 
thrusters.  Plots  8,  9,  16,  20. 

Note  slight  downward  pitch  angle  6  due  to  coupling  with 
vertical  heave  velocity  rate  vv  via  coefficient 

Plots  6,  7,  15. 

1:26 

S6.0 

Reached  ordered  course  090°. 

Begin  lateral  motion  to  right  using  lateral  thrusters. 

Plots  2,  12,  16,  20. 

1 :29 

89.0 

Reverse  lateral  thrust  to  cancel  sway  velocity  v. 

Plots  2,  12,  16,  20. 

1 

32 

92.0 

Lateral  sway  velocity  v  reduced. 

Change  course  to  left  to  020°  using  thrusters. 

Plots  8,  9,  16,  20. 

1:37 

97.0 

Still  changing  course. 

Turn  on  propellers  to  400  rpm,  enabling  rudders  and  planes. 

Plots  1,  8,  9,  11,  16,  17,  18,  19,  20. 

1:41 

lOl.O 

Continue  changing  course  left  to  005°  for  test  tank  window  exit. 
Forward  surge  velocity  u  starting  to  increase. 

Plots  1,  8,  9,  11,  16,  17,  18,  19,  20. 

1:50 

110.0 

Continue  changing  course  left  to  000°  for  test  tank  window  exit. 

2.01 

121.3 

Building  up  speed,  ready  to  maneuver  to  enter  torpedo  tube. 

Come  left  to  course  270°,  go  down  to  depth  48.2  ft  using 
propellers,  planes  and  thrusters  simultaneously  combined. 
CoiTesponding  graphics  images  appear  in  Figure  9.23  and 

Figure  9.24.  Plots  1  through  20. 
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time 

mm:ss 


time 

sec 


Analytic  results,  ordered  robot  changes  and  pertinent  plots. 


2:27 

147.4 

Toipedo  tube  transit  completed  via  dead  reckoning. 

Change  course  to  left  to  180°. 

Plots  1.  2,  3.  5,  8,  9,  11.  12,  14,  15,  16,  17,  20. 

2:37 

157.4 

Steady  on  course,  forward  surge  velocity  u  starting  to  increase. 
Secure  thrusters.  Begin  going  shallow  to  ordered  depth  4  ft 
using  forwai'd  momentum,  plane  surfaces  and  propellers. 

Plots  1,  4,  6,  7,  10,  13,  15,  18. 

2:57 

177.4 

While  continuing  to  shallow,  begin  a  spiral  to  right. 

Ordered  rudder  held  at  -12°.  AUV  geographic  position  stays 
within  ordered  turning  radius  during  extended  depth  ti'ansient. 
Changes  and  interactions  are  again  visible  among  all 
hydrodynamics  variables.  Plots  1  through  20. 

3:40 

220.4 

Near'  ordered  depth  just  below  the  surface. 

Turn  on  thrusters,  resume  closed-loop  rudder  conuol  by 
ordering  course  090°.  Head  back  to  origin  above  the  pool. 

Vehicle  roll  p  from  spiral  turn  restabilizes  with  forward  motion. 
Plots  1,  2,  3,  5,  6,  8.  9,  10,  11,  12,  14,  16,  17,  20. 

3:58 

238.4 

Nearing  origin,  slow  and  stabilize. 

Reverse  propellers  to  -400  rpm,  reducing  forward  velocity  u. 

Plots  1.  2.  3,  11,  19. 

4:08 

248.4 

Forward  velocity  u  almost  zero,  near  origin. 

Zero  propellers,  coast,  slow  due  to  drag  and  stabilize. 

Plots  1,  2,  3,  11,  19. 

4:18 

258.4 

Approximately  at  origin  with  small  velocities  remaining. 

Change  ordered  course  to  000°  and  shift  to  hover  mode. 

New  ordered  position  for  hovering  is  origin,  depth  0  ft. 

Propellers  now  follow  forward/aft  position  error, 

all  plane  surfaces  zeroed,  vertical  thrusters  control  depth,  and 

lateral  thrusters  track  port/starboard  position  error. 

Plots  2,  3,  4,  5,  7,  8,  9,  10.  11,  12,  13,  15,  16,  19,  20. 

5:50 

350.0 

Hovering  has  fully  stabilized  AUV  at  origin  with  zero  posture. 
Mission  complete. 

Plots  1  through  20  stable. 
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Figure  9.4.  World  position  coordinate  x  and  derivative  versus  time  t. 
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Figure  9.7.  World  roll  Euler  angle  <|)  and  derivative  versus  time  t. 


Figure  9,8.  World  pitch  Euler  angle  0  and  derivative  versus  time  t. 
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Figure  9,9.  World  theta  Euler  angle  0  and  related  variables  versus  time  t. 


Figure  9.10.  World  yaw  Euler  angle  \|/  and  derivative  versus  time  t. 
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Figure  9.11.  World  yaw  Euler  angle  \j/  and  lateral  thrusters  versus  time  t. 


Figure  9.12.  World  depth  coordinate  z  and  related  variables  versus  time  t. 
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Figure  9.13.  Body  longitudinal  surge  vcloeity  u  versus  time  t, 


Figure  9.14.  Body  lateral  sway  velocity  v  versus  time  t. 
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Figure*  y.lS.  body  vertical  heave  velocity  rv  versus  time  t. 


Figure  9.16.  Body  longitudinal  rotation  roll  rate  /;  versus  time  t. 
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Figure  9.18.  Body  vertical  rotation  yaw  rate  r  versus  time  t. 
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AUV  bow  planes  rotation  (stern  planes  opposed)  versus  time  t. 
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Figure  9.21.  AUV  port  and  .starboard  propeller  speed  versus  time  t. 


Figure  9.22.  AUV  vertical  and  lateral  thruster  control  voltages  versus  time  t. 


Fi[jure  9.23, 


AUV  initial  turn  and  depth  change  tVuin  the  test  tank  to  the 
torpedo  tube  u.sing  all  thrusters,  propellers  and  planes. 


igure  9.24. 


AUV  nearing  entry  to  torpedo  tube.  Note  counterintuitive 
(but  correct)  opposition  of  lateral  thrusters  to  propeller  and  rudder 
control,  damping  yaw  rate  r  and  preventing  overshoot. 


I).  NETWORK  TESTIN(J  AT  The  Edge 

Distribution  of  underwater  virtual  world  components  enables  scalability  and 
real-time  response,  both  for  robot  world  models  and  for  people.  The  distributed 
implementation  of  the  underwater  virtual  world  (Brutzman  94e)  was  tested  and 
demonstrated  for  six  days  as  part  of  The  Edge  exhibition  at  the  SIGGRAPH  94 
conference,  held  in  Orlando  Florida  (Brutzman  94b,  94c).  We  estimate  that  2,000  of 
32.000  SIGGRAPH  attendees  stopped  at  our  underwater  virtual  world  exhibit  to 
observe  a  robot  mission  and  leai'ii  about  the  project.  Robot  interactions  in  the  virtual 
world  were  also  multicast  over  the  MBone  with  worldwide  scope  (ttl  127)  using  audio, 
video  and  DIS  channels. 

d’he  forty  reviewed  exhibits  in  The  Edge  were  representative  of  leading  computer 
graphics  applications  in  the  world.  The  Edge  was  intended  to  include  shared 
experiences,  simulation,  training,  education,  virtual  environments,  high-bandwidth 
networked  graphics,  telepresence  and  teleroboties.  llie  underwater  virtual  world 
irroject  has  components  and  relevance  in  each  of  those  areas.  Our  objective  was  to 
inspue  and  stimulate  attendees  to  consider  a  myriad  of  opportunities  previously 
considered  infeasible.  F'eedback  conunents  from  visitors,  SIGGRAPH  organizers  and 
the  press  (Meyer  94)  were  uniformly  enthusiastic. 

One  technical  goal  during  this  demonstiation  was  to  evaluate  netwoRk  loading. 
Bandwidth  budget  plans  called  for  an  average  bandwidth  of  225  kilobits  per  second 
(Kbps)  is  available  (i.e.  25%  of  a  1.5  Mbps  T1  Internet  connection).  This  bandwidth 
budget  included  128  Kbps  for  locally  generated  video/graphics,  64  Kbps  for  a  shai'ed 
audio  channel  and  15  Kbps  for  sending  DIS  PDUs.  128  Kbps  is  the  default  bandwidth 
for  world-wide  multicast  video  programs  and  equates  to  1-3  frames  per  second. 

Lower  or  higher  bandwidtlis  and  a  corresponding  change  in  frame  rate  are  feasible. 

DIS  Entity  State  PDU  size  for  the  NPS  AUV  is  larger  than  the  nominal  DIS 
PDU  default,  since  three  articulated  parameters  are  attached  to  each  AUV  PDU  for 
sonar,  plane  surface,  propeller  and  thruster  values.  DIS  protocol  bandwidth  for  the 
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SIGGRAPH  demoiisti'utions  were  based  on  these  PDUs  being  multicast  at  full  virtual 
world  update  frequency  of  10  Hz. 


DIS  bandwidth  -  (multicast  PDU  update  rate)  [PDUsize 


=  (lOHz  update  rate) 


=  15.36  Kbps 


1152  bits  ^  3 

f  128  bits  y 

PDU 

articulated 
^parameter  j 

(9.1) 


This  full  update  rate  of  10  Hz  was  used  to  relay  every  possible  nuance  related  to 
physical  motion  of  the  highly  dynamic  autonomous  underwater  vehicle.  By  way  of 
contrast,  a  standard  Entity  State  PDU  with  no  articulated  parameters  being  relayed  at 
the  maximum  standard  interval  of  5  seconds  produces  only  a  0.23  Kbps  bandwidth 
load, 

Another  important  way  of  making  virtual  worlds  widely  available  is  developing 
an  information  infrastructure  where  potential  virtual  world  participants  have  the 
network  capabilities  to  participate.  Toward  this  end  we  have  utilized  MBone  in  a 
number  of  scholarly  conferences.  Objectives  are  usually  twofold:  learn  how  to  use 
global  videoconferencing  more  effectively,  and  assist  potential  collaborators  in 
learning  more  and  connecting.  We  have  achieved  a  steady  series  of  successes  at  a 
variety  of  sites  including  HAJS  U.S.  Geological  Survey  Menlo  Park  scientific 
visualization  workshop,  the  International  Advanced  Robotics  Programme  (lARP) 
Mobile  Robotics  for  Subsea  Environments  94  (Brutzman  94a),  IEEE  Autonomous 
Underwater  Vehicles  94  (Brutzman  94d),  GLOSAS  Global  Lecture  Hall  of  July  94 
(McLeod  94),  and  SIGGRAPH  94  (Brutzman  94b,  94c).  Effectiveness  of  these 
techniques  has  been  formally  evaluated  (Gambrino  94)  with  typically  positive  and 
enthusiastic  results  (Macedonia,  Brutzman  94).  It  is  our  belief  that  use  of  MBone  in  a 
vai'iety  of  media  will  continue  to  grow  at  a  slow  but  exponential  rate,  and  it  is  oui' 
experience  that  familiarity  and  practice  overcomes  limitations  associated  with 
bandwidth  restrictions. 

The  combined  use  of  socket  connectivity,  MBone  audio/video/graphics/PDUs, 
the  DIS  protocol  and  World-Wide  Web  (WWW)  functionality  means  that  the 
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underwater  virtual  world  is  an  excellent  application  to  take  advantage  of  a 
high-bandwidtli  information  superhighway,  further  extending  the  capabilities  of 
multiple  researchers.  The  network  approach  allows  many  individuals  dynamic  remote 
access,  and  distributing  components  minimizes  dependence  on  unique  (or 
hard-to-replace)  hardware  and  software.  The  DIS  protocol  permits  compatible 
interaction  with  other  virtual  worlds  over  the  Internet.  Providing  hypermedia  access 
via  publicly  available  WWW  browsers  such  as  Mosaic  makes  a  complete  variety  of 
pertinent  archived  information  available  to  anyone.  Such  information  media  include 
images,  papers,  datasets,  softwai'e,  sound  clips,  text  and  any  other  computer-storable 
media.  This  supports  another  long  term  objective  of  the  project,  which  is  to  continue 
extending  the  scope  of  virtual  world  entities  and  simplifying  virtual  world  interfaces  in 
order  to  become  useful  as  an  exemplar  application  for  education.  Thus  an 
infrastructure  is  evolving  whereby  virtual  worlds  can  support  remote  scientific 
collaboration  and  education,  both  regionally  and  globally. 


i:.  SUMMARY  AND  FUTURE  WORK 


This  chapter  showed  experimental  results  in  hydrodynamics,  Internet-wide 
network  loading  and  remote  collaboration.  Hydrodynamics  behavior  of  an  underwater 
vehicle  is  shown  to  be  highly  complex  and  dependent  on  a  Iturge  number  of  interacting 
valuables.  Temporal  plots  permit  precise  analysis  of  results,  but  real-time  3D  graphics 
playback  is  requhed  for  overall  evaluation  and  insight.  From  a  network  perspective, 
the  Internet  is  currently  capable  of  supporting  the  variety  of  high-bandwidth 
information  sU'eams  needed  for  full  virtual  world  connectivity.  Tested  sUeams  include 
point-to-point  telemeU';/  sockets,  audio,  video,  graphics,  DIS  PDUs  and  archived 


multimedia.  Addition  of  arbitrarily  large  numbers  of  virtual  world  viewers  is  shown 
possible  through  use  of  the  MBone  for  time-sensitive  information  such  as  audio,  video 
and  DIS  position  updates. 

Future  work  on  experimental  results  is  extensive  because  use  of  the  underwater 
virtual  enables  many  new  capabilities,  Top  priority  is  to  reintegrate  execution  level 
software  in  the  actual  vehicle  and  reproduce  virtual  world  results  in  the  real  world. 
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Regrettably,  the  long  break  in  1994  AUV  testing  due  to  hydrogen  explosion  repairs 
has  precluded  running  any  of  these  missions  in  the  water.  This  lack  of  validating  test 
data  duplicating  virtual  world  mi.ssions  in  the  real  world  has  precluded  performing  a 
"Turing  Test"  of  virtual  world  operations.  A  top  priority  for  1995  is  to  stabilize  the 
equipment  rebuild  and  upgrade  the  execution  level  robot  control  program  to  use  new 
hardware  interfaces.  At  that  point  virtual  world  test  results  are  expected  to  be 
completely  validated  again.st  identical  missions  run  in  the  test  tank. 

Collaboration  with  other  underwater  robotics  and  virtual  world  researchers  is 
highly  desirable  in  order  to  scale  up  the  scope  of  the  underwater  virtual  world.  A 
formal  validation  and  verification  confidence  asse.ssment  can  improve  project 
implementation  and  may  help  formally  claiify  the  fundamental  requiiements  needed 
fur  global  internetworked  large-scale  virtual  worlds.  Exciting  future  possibilities 
include  use  of  the  underwater  virtual  world  as  an  educational  tool,  as  a  testbed  for  new 
AUVs,  and  as  a  means  for  providing  context  amidst  the  gigantic  mass  of  information 
content  which  is  being  connected  via  the  Internet. 


X.  CONCLUSIONS  AND  RECOMMENDATIONS 


A.  PRINCIPAL  DISSERTATION  CONCLUSIONS 

Construction  of  un  underwater  virtual  world  is  feasible.  Using  3D  real-time 
computer  graphics  in  an  underwater  virtual  world  enables  effective  AUV  development. 
Visualization  of  robot  interactions  in  an  underwater  virtual  world  improves  our 
perceptual  ability  to  evaluate  robot  performance.  A  networked  robot  and  virtual  world 
enables  researchers  to  "'.'cale  up"  to  extremely  high  degrees  of  complexity,  and  makes 
robotics  reseajch  and  collaboration  accessible  worldwide. 

A  comprehensive  software-hardware  architecture  for  a  general  AUV  underwater 
virtual  world  demonstrates  the  feasibility  of  these  concepts.  Several  components 
make  up  this  virtual  world.  A  complete  underwater  vehicle  dynainics  model 
suitable  for  physics-based  real-time  simulation  is  developed.  Real-time  visualization 
of  AUV  and  sen.'.ors  interacting  with  a  realistic  environment  is  achieved  by  decoupling 
robot-virtual  world  interactions  from  graphics  by  the  use  of  the  Distributed  Interactive 
Simulation  (DIS)  protocol.  World-wide  accessibility  is  provided  using  the 
World-Wide  Web  (WWW)  for  software  archive  reti'ieval  and  the  Multicast  Backbone 
(MBone)  for  live  streams.  Convenient  and  comprehensive  network  connectivity 
enables  effective  scientific  collaboration  among  researchers  and  robots. 

IJ.  SPECIFIC  CONCLUSIONS,  RESULTS  AND  RECOMMENDATIONS  FOR 

FUTURE  WORK 

Additional  detailed  conclusions  appear  at  the  end  of  each  chapter. 

1.  Underwater  Robotics 

A  large  gap  ween  theory  and  practice  has  resulted  in  relatively  few 
underwater  robots.  The  difficulties  of  the  underwater  envkonment  are  as  severe  as 
any  other,  making  any  AUV  failure  potentially  fatal.  AUV  software  and  hardware 
solutions  are  available  but  many  problems  remain  due  to  difficulty  integrating 


226 


component  solutions.  Real-time  control  under  complex  dynamic  and  temporal 
constraints  is  essential.  Stability  and  reliability  are  pai'amount  but  testing  is  difficult. 
Virtual  worlds  may  help  break  the  AUV  development  bottleneck. 

A  large  number  of  open  tasks  await  underwater  robot  designers.  Insistence 
on  in-water  testing  following  laboratory  simulation  is  needed  to  ensure  that  progress  is 
cumulative  and  grounded  in  reality.  AUVs  ai'e  beginning  to  perform  important  tasks 
tliat  cannot  be  done  effectively  by  other  platform.s.  Both  NPS  and  the  AUV 
community  is  poised  for  significant  real  world  accomplishments  such  as  effective 
minefield  search. 

2.  Object-Oriented  Real-Time  (iraphics 

Interactive  3D  graphics  are  used  as  our  window  into  virtual  worlds. 
Graphics  are  completely  decoupled  from  robot-virtual  world  interaction  in  order  to 
permit  real-time  performance  for  robot  and  world  models.  Graphics  viewers  can  be 
effectively  networked  to  use  the  global  Internet  as  an  input/output  device,  i.e.  as  a 
source  or  target  for  any  information  stream  desired.  Object-oriented  graphics  models 
supported  by  scene  de.scription  languages  are  essential  for  scaling  up  virtual  worlds, 
Rendering  and  network  compatibility  across  multiple  platforms  is  highly  desirable. 
Open  Inventor  and  the  propo.sed  Virtual  Reality  Modeling  Language  (VRML)  are 
well  suited  for  virtual  world  const! uction  and  rendering,  Future  work  includes 
increasing  the  number  of  objects  populating  the  virtual  world,  adding  hooks  to  objects 
on  remote  servers  via  URL  definitions,  and  porting  to  other  aichitectures  to  encourage 
widespread  u.se  of  the  underwater  virtual  world.  Since  the  physical  size  and  scope  of 
an  underwater  virtual  world  is  very  large,  it  is  a  good  candidate  for  a  lai’ge  immersive 
environment  such  as  a  CAVE  (Cruz-Neira  93). 

3.  Underwater  Vehicle  Hydrodynamics  Models 

No  hydrodynamics  model  was  previously  available  which  was  suitable  for 
real-time  simulation  pe.formauce  in  hover  and  cruise  modes.  A  general  standai'dized 
and  parameterized  hydrodynamics  model  is  pre.sented  based  on  numerous  preceding 


227 


models,  rigorous  physical  derivations  and  empirical  testing.  The  model  is 
computationylly  elTicient,  capable  of  running  at  short  intervals  (10  Hz)  and  networked 
using  the  DIS  protocol.  Future  work  includes  implementation  of  the  hydrodynamics 
model  for  other  vehicles,  extension  to  include  .special  effects  such  as  tethers  and  wave 
motion,  connection  to  a  i.irge-scale  world  collision  detection  model,  and  possible 
porting  into  vehicle  software  as  a  predictive  "world  in  the  loop"  for  intelligent  control 
and  machine  learning  supeivisicn. 

4.  Metworking 

'■’he  key  considerations  in  networking  virtual  worlds  concern  compatibility, 
bandwidth  and  .scalability.  The  Internet  Protocol  (IP)  suite  is  es.sential  for  global 
compatibility.  Point-to-point  sockets  are  capable  of  supporting  tightly-coupled  world 
models  interacting  with  a  robot.  The  IEEE  DIS  protocol  permits  entities  to  compatibly 
communicate  and  interact  at  the  entity/application  level.  Multicast  protocols  allow 
bandwidth  reduction  for  both  transmis.sion  and  reception,  a  necessary  step  for  .scaling 
beyond  limited  numbers  (hundreds)  of  iitteructing  entities.  Scalability  is  also 
supported  through  the  u.se  of  World-Wide  Web  compatibility  which  provides  flexible 
and  well-defined  communications  mechanisms  for  information  retrieval.  Future  work 
includes  continuing  to  scale  up  using  DIS,  multicast  and  the  World-Wide  Web,  and 
also  building  a  persistent  underwater  virtual  world  server  for  continuous  availability  to 
humans  and  robots  using  the  Internet. 

5.  Sonar  Modeling  and  Visualization 

Many  sonar  models  are  available  but  most  are  highly  specialized  and  none 
appear*  to  be  suited  for  general  use.  Based  on  initial  testing  and  validation,  the 
Recursive  Ray  Acoustics  (RRA)  Algorithm  sonar  model  (Ziomek  93)  holds 
exceptional  promise  due  to  computational  efficiency,  frequency  consU'aint 
independence,  sound  speed  profile  (SSP)  consti’aint  independence  and  bathymeti'y 
constraint  independence.  Sonar  visualization  is  the  application  of  scientific 
visualization  techniques  to  enable  effective  analysis  of  high-dimensionality  sonar*  data. 
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Sonar  visualization  also  holds  great  promise  as  a  means  of  effectively  interpreting 
robot  sensor  interactions  in  a  counterintuitive  environment.  Future  work  starts  with 
porting  the  RRA  C-translation  offline  model  to  become  an  online  model,  possibly  by 
adding  hooks  to  the  original  RRA  FORTRAN  source  code.  Visualization  tools  will  be 
used  to  exireriment  with  effective  matches  betv^een  the  high  dimensionality  of  sonar 
parameters  and  the  high  dimensionality  of  graphics  rendering  techniques.  The  most 
promising  visualization  results  will  be  used  for  real-time  rendering  of  sonar' 
transmissions  in  the  underwater  virtual  world. 

C.  NEXT  STEP;  BUILDING  A  LARGE-SCALE 

UNDERWATER  VIRTUAL  WORLD 

Results  in  this  dissertation  have  stressed  the  possibilities  of  scalability  to 
arbitrarily  large  levels.  Having  shown  that  comprehensive  real-time  robot  operation  is 
possible  in  a  vu'tual  world,  it  is  now  appeal's  po.ssible  to  scale  up  while  including 
numerous  independently  acting  human  and  robot  entities.  Scientific  rigor  can  be 
provided  by  examining  inputs,  outputs  and  constraints  on  vai'ious  world  models  and 
defining  ways  for  these  models  to  interact  in  theoretically  con'ect  ways.  The 
exponential  and  open  growth  of  the  World-Wide  Web  has  been  possible  due  to  the 
open  capabilities  of  the  Hypertext  Maikup  Language,  providing  an  excellent  exemplai' 
for  sustained  exponential  growth.  It  is  likely  that  VRML  or  related  efforts  will  enable 
similar  growth  of  virtual  worlds  and  virtual  world  components. 

Virtual  worlds  have  the  potential  to  completely  change  the  current  paradigms  of 
how  people  use  information.  This  work  points  out  promising  directions  for  connecting 
information,  robots  and  people  in  ways  that  provide  context,  meaning  and  substance. 
The  real  world  is  the  best  model  for  a  virtual  world.  When  our  virtual  constructs 
cumulatively  approach  realistic  levels  of  depth  and  sophistication,  our  understanding  of 
the  real  world  will  deepen  correspondingly. 
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APPENDIX  A.  ACRONYMS 


3D 

three  dimensional 

A1 

artificial  intelligence 

ALAN 

Acoustic  local  area  network 

ANSI 

American  National  Standards  Institute 

AOSN 

Autonomous  Oceanographic  Sampling  Network 

API 

application  program  interface 

AkPA 

Advanced  Research  ftojects  Agency 

(formerly  DARPA,  originally  ARPA) 

atan2  {y,  .vj 

arctangent  function,  returns  angle  to  a  point  in  proper  quadrant 

ATM 

Asynchronous  Transfer  Mode 

AUV 

autonomous  underwater  vehicle 

BSD 

Berkeley  Softwai'e  Distribution  (a  Unix  variant) 

CB 

center  of  buoyancy 

CFD 

computational  fluid  dynamics 

CG 

center  of  gravity 

dB 

1 

decibel  (logaiithmic  unit  of  measure  of  sound  intensity) 

DBS 

Data  Encryption  Standard 

1  DIS 

IEEE  Distributed  Interactive  Simulation  Protocol 

DoD 

U.S,  Depai'tment  of  Defense 

DOF 

degrees  of  freedom 

1  dynamics 

AUV  Underwater  Virtual  World  component:  hydrodynamics, 

network  connections  and  other  real-tinre  models  (e.g.  sonar) 

1  execution 

AUV  Underwater  Virtual  World  component:  robot  execution  level 

FEC 

forward  error  compression  -  encoding  scheme  that  includes 

redundant  information  to  reduce  probability  of  data  loss 

ftp 


('.I\S 

html 

http 

1EI£E 

1‘LA 

IP 

I  PC 

Irix 

ISDN 

ISO 

.iv 

Kbps 

LAN 

lyiL\ 


MAPS 


MBone 

Mbps 

MIDI 

MIME 

MOE 

Mosaic 

mroLited 

NPS 


File  Transfer  Protocol,  refers  both  to  host  servers  providing 
information  and  clients  connecting  for  information  retrieval 
Global  Positioning  System 
Hypertext  Markup  Language 

Hypertext  Transfer  Protocol,  refers  both  to  host  servers  providing 

information  and  clients  connecting  for  information  retrieval 

Institute  of  Electrical  and  Electronics  Engineers 

Initiative  fur  Information  Infrastructure  and  Linkage  Applications, 

a  Monterey  Hay  regional  K-16  educational  network  collaboration 

liitcrnct  Protocol 

intcr-iirocess  communications 

Unix  as  implemented  on  SGI  workstations 

Integrated  Services  Digital  Network 

International  Organization  fur  Standardization 

Open  Inventor  scene  description  language  filename  extension 

Kilobits  per  second 

local  aiea  network 

WWW  browser  with  line  mode  interlace,  usable  within  application 
programs  as  a  client  to  reuieve  files  from  WWW 

ARl-NASA  Ames-Naval  Postgraduate  School-^tanford 
Aerospace  Robotics  Lab  effort  to  build  next-generation  AUV 
Multicast  Backbone 
Megabits  per  second 
Musical  Instrument  Digital  Interface 
Multipurpose  Internet  Mail  Extensions  (RFC  1341) 
measure  of  effectiveness 
WWW  browser  with  graphical  user  interface 
multicast  router  daemon 
Naval  Postgraduate  School 
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IIV 

UUSPlCs 

os-y 

osi 

I’DU 

RBM 

RFC 


ROV 

ipm 

RRA 

SAI' 

Sll 

SDV-y 

SGI 

suiiur 

SFL 

SSF 

SVF 

Tcl/'l’k 

TCP 

telnet 

ttl 

UDP 

URL 

IISN 

UUV 

vat 


network  video  MBone  application  tool  for  video  and  graphics 

Object-Oriented  Simulation  Pictures 

Real-time  operating  system  produced  by  Microware  Inc. 

Open  Systems  Interconnection  reference  model 
protocol  data  unit 
Rational  Behavior  Model 

Request  For  Comments,  draft  Internet  documents  provided  for 

information  or  standards  development  ' 

remotely  oitcrated  vehicle 

revolutions  per  minute 

Recursive  Ray  Acoustics  sonar  algorithm 

semi-automated  forces 

setitiion  directory  MBone  application  tool  for  session  advertisement 
and  selection 

Swimmer  Delivery  Vehicle,  hull  9 
Silicon  Graphics  Inc. 
sound  Navigation  And  Ranging 
sound  pressure  level 

sound  speed  profile  (measured  versus  depth) 
sound  velocity  profile  (typically  a  nrisnomer  for  SSP) 

Tool  control  languagc/Tool  kit 

Transmission  Control  Protocol,  part  of  IP  transport  layer 

virtual  terminal  protocol  permitting  remote  system  login 

time'-to-live  packet  hop  counter 

User  Datagram  Protocol,  part  of  IP  transport  layer 

Universal  Resource  Locator 

U.S.  Navy 

unmanned  underwater  vehicle,  may  be  controlled  remotely 
vi.sual  audio  tool  MBoin'  application  tool  for  audio 
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viL'Wi'r 


viinl 
VV  it  A 
wh 

WWW 


AUV  Underwater  Virtual  World  component:  netwoited  3D 
real-time  graphics  to  remotely  view  robot  operating  in  virtual  world 
Virtual  Reality  Modeling  Language 
validation  verification  and  accreditation 

whiteboard  MBone  application  tool  for  shared  drawing  and  images 
World-Wide  Web 
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APPENDIX  B.  VIDEO  DEMONSTRATION 


A.  INTRODUCTION 

This  section  briefly  describes  the  contents  and  objectives  of  the  video  appendix. 

B.  NPS  AUV  OPERATING  IN  THE  UNDERWATER  VIRTUAL  WORLD: 
THE  SIGGRAPH  MISSION 

This  video  segment  shows  a  six  minute  mission  in  the  underwater  virtual  world. 
It  first  appeared  in  the  Video  Proceedings  of  the  AUV  94  conference  (Brutzman  94a). 
The  original  abstract  follows: 


A  critical  bottleneck  exists  in  Autonomous  Underwater  Vehicle  (AUV)  design 
and  development.  It  is  tremendously  difficult  to  observe,  communicate  with  and 
test  underwater  robots,  because  they  operate  in  a  remote  and  hazardous 
environment  where  physical  dynamics  and  sensing  modalities  are 
counterintuitive. 

An  underwater  virtual  world  can  comprehensively  model  all  salient  functional 
characteristics  of  the  real  world  in  real  time.  This  virtual  world  is  designed 
from  the  perspective  of  the  robot,  enabling  realistic  AUV  evaluation  and  testing 
in  the  laboratory.  Three-dimensional  real-time  graphics  are  our  window  into 
that  virtual  world.  Visualization  of  robot  interactions  within  a  virtual  world 
permits  sophisticated  analyses  of  robot  performance  that  are  otherwise 
unavailable.  Sonar  visualization  permits  researchers  to  accurately  "look  over 
the  robot’s  shoulder"  or  even  "see  through  the  robot’s  eyes"  to  intuitively 
understand  sensor-environment  interactions. 

Distribution  of  underwater  virtual  world  components  enables  scalability  and 
real-time  response.  The  ILEE  Distributed  Interactive  Simulation  (DIS)  protocol 
is  used  for  compatible  live  interaction  with  other  virtual  worlds.  Network 
access  allows  individuals  remote  observation.  Mosaic  and  the  World-Wide  Web 
provides  open  access  to  archived  images,  papers,  datasets,  software,  sound 
clips,  text  and  any  other  computer-storable  media.  This  project  presents  the 
frontier  of  3D  real-time  graphics  for  underwater  robotics,  ocean  exploration, 
sonar  visualization  and  worldwide  scientific  collaboration.  (Brutzman  94a) 
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C.  NPS  AUTONOMOUS  UNDERWATER  VEHICLE 


This  video  segment  shows  the  basic  functionality  of  the  NPS  AUV.  It  first 
appeared  in  the  Video  Proceedings  of  the  IEEE  International  Conference  on  Robotics 
and  Automation  1992,  and  the  Video  Proceedings  of  the  Eighth  International 
Symposium  on  Unmanned  Untethered  Submersible  Technology 
(Brutzman  92a,  92b,  93a).  The  original  abstract  Ibllows: 

The  Naval  Postgraduate  School  (NPS)  Autonomous  Underwater  Vehicle 
(AUV)  is  an  eight  foot  long,  387-pound  untethered  robot  submarine  designed 
for  research  in  adaptive  control,  mission  planning,  navigation,  mission 
execution,  and  post-mission  data  analysis.  Neutral  buoyancy,  eight  plane 
surlaces  and  twin  propellers  allow  precise  maneuverability. 

Simulation  programs  running  on  Iris  three-dimensional  graphics  workstations 
are  used  to  evaluate  NPS  AUV  software  and  predict  system  performance  prior 
to  each  mission.  Graphics  simulations  can  replay  in  real  time  actual  data 
collected  in  the  pool.  The  taped  playback  demonstrates  reconstruction  and 
visualization  of  vehicle  track,  control  systems  dynamic  response,  logic  and  state 
changes,  plotted  locations  of  individual  sonar  returns,  and  expert  system 
classification  of  detected  objects. 


Ongoing  NPS  AUV  research  is  investigating  linear  and  nonlinear  control 
techniques,  advanced  sonar  classification,  failure  mode  analysis  using  neural 
networks,  dynamic  path  and  search  planning,  use  of  cross-body  thrusters  for 
hovering  control,  alternate  AUV  operating  architectures,  incorporation  of  Global 
Positioning  System  (GPS)  receiver  navigation,  and  construction  of  an 
underwater  virtual  world  to  permit  complete  and  realistic  testing  of  every  aspect 
of  AUV  operation  in  the  laboratory.  (Brutzman  92a,  92b,  93a) 


D.  LIVE  EXHIBIT  AIND  WORLDWIDE  MULTICAST  AT 
The  Edge,  SIGGRAPH  94 

This  segment  shows  the  NPS  AUV  Underwater  Virtual  World  exhibit  at 
The  Edge,  SIGGRAPH  94  (Brutzman  94b,  94c).  Video  photographer  is 
Michael  J.  Zyda. 
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E.  NFS  AUV  WORLD-WIDE  WEB  HOME  PAGE 

This  video  segment  shows  how  to  connect  to  the  NPS  AUV  home  page  and 
retrieve  the  underwater  virtual  world  distribution.  Installation  is  also  demonstrated. 

F.  EXTENDED  NPS  AUV  MISSION  REPLAYS 

Additional  NPS  AUV  missions  are  run  from  the  underwater  virtual  world 
archive  distribution,  evaluating  a  variety  of  hydrodynamic  and  sonar  responses. 

G.  NPS  AUV  POSTURE  CONTROL 

This  video  segment  demonstrates  in-water  test  tank  results  from  early  1994. 

It  first  appeared  in  the  Video  Proceedings  of  the  AUV  94  conference  (Brutzman  94a) 
by  authors  A.J.  Healey,  D.B.  Marco,  R.B.  McGhee,  D.P.  Brutzman,  R.  Cristi  and 
F.A.  Papoulias.  The  original  abstract  follows: 


Recent  work  with  the  NPS  AUV  11  demonstrates  further  development  of  the 
execution  level  software  to  incorporate  hover  control  behavior  in  the  NPS  hover 
tank.  Of  particular  interest  is  the  use  of  the  ST  100  and  ST  725  high  frequency 
sonars  to  provide  data  about  the  environment.  Thus  positioning  can  be 
accomplished  without  the  use  of  beacoris. 

Motion  behaviors  may  be  instituted  that  include  diving  and  pitch  control 
under  thruster  power,  heading  control  at  zero  speed,  lateral  and  longitudinal 
positioning,  as  well  as  the  automatic  initiation  of  filters  as  needed  when  a  new 
target  is  found.  A  simple  task  level  language  is  developed  that  will  be  used  to 
direct  tactical  level  output  to  a  port  which  communicates  with  execution  level 
software.  (Healey  abstract,  Brutzman  94a) 
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H.  MBone:  AUDIO/VmEO  INTERNET  TOOLS  FOR  INTERNATIONAL 


COLLABORATION 

This  video  segment  describes  and  demonstrates  use  of  the  MBone.  It  was 
recorded  from  a  worldwide  MBone  broadcast  of  the  May  1994  International  Advanced 
Robotics  Programme  (lARP):  Mobile  Robots  for  Subsea  Environments,  hosted  by  the 
Monterey  Bay  Aquarium  Research  Institute  (MBARI).  It  originally  appeared  at  in  the 
Video  Proceedings  of  the  AUV  94  conference  (Brutzman  94a).  MBone  media 
strength.^  and  limitations  videoconference  are  formally  evaluated  in  (Gambrino  94) 
using  this  videoconference.  The  original  abstract  follows: 

Recently  it  has  become  possible  to  broadcast  live  audio  and  video  over  the 
Internet  using  the  Multicast  Backbone  (MBone).  This  development  holds  great 
promise  as  an  enabling  technology  for  collaborative  work  among  underwater 
vehicle  researchers  separated  by  long  distances. 

This  talk  describes  technical  considerations  related  to  use  of  the  MBone, 
which  is  the  virtual  network  used  for  these  Internet  sessions.  Anyone  with 
direct  Internet  connections,  adequate  bandwidth  and  a  workstation  can  receive 
multicast.  We  hope  to  demonstrate  that  worldwide  collaboration  among 
underwater  robotics  researchers  is  not  only  feasible  but  even  convenient. 

For  more  information  on  how  to  connect  your  lab  to  MBone,  refer  to 
"MBone  Provides  Audio  and  Video  Across  the  Internet"  in  the  April  94  issue  of 
IEEE  COMPUTER,  pp.  30-36.  This  article  is  also  available  for  electronic 
retrieval  in  PostScript,  text,  and  hypertext  versions: 
ftp :  //taurus .  cs .  nps .  navy .  m  il  /pub.'i31a/ mbone .  ps 
ftp://taurus.cs.nps.navy.mil/pub/i31a/mbone.txt 
ftp :  //taurus .  cs .  nps .  navy .  m  il  /pub/i3Ia/mbone .  htm  1  (Brutzman  94a) 
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